-- Logs begin at Tue 2022-07-12 09:25:28 UTC, end at Tue 2022-07-12 10:27:28 UTC. -- Jul 12 10:00:32.321091 dv-osbrick-849324-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 10:00:32.329697 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 10:00:32 2022] *** Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: nodename: dv-osbrick-849324-2-ceph Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: machine: x86_64 Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: clock source: unix Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: pcre jit disabled Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: detected number of CPU cores: 4 Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: current working directory: / Jul 12 10:00:32.331748 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: detected binary path: /usr/bin/uwsgi-core Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: your processes number limit is 47680 Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: your memory page size is 4096 bytes Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: detected max file descriptor number: 2048 Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: lock engine: pthread robust mutexes Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: thunder lock: enabled Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 10:00:32.332391 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 10:00:32.381423 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: Python main interpreter initialized at 0x56186c3099c0 Jul 12 10:00:32.381423 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: python threads support enabled Jul 12 10:00:32.381423 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: your server socket listen backlog is limited to 100 connections Jul 12 10:00:32.381423 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: your mercy for graceful operations on workers is 90 seconds Jul 12 10:00:32.381749 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 10:00:32.381823 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: *** Operational MODE: preforking *** Jul 12 10:00:32.382087 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: *** uWSGI is running in multiple interpreter mode *** Jul 12 10:00:32.382087 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: spawned uWSGI master process (pid: 87391) Jul 12 10:00:32.382289 dv-osbrick-849324-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 12 10:00:32.383230 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: spawned uWSGI worker 1 (pid: 87401, cores: 1) Jul 12 10:00:32.383230 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: spawned uWSGI worker 2 (pid: 87402, cores: 1) Jul 12 10:00:32.383385 dv-osbrick-849324-2-ceph devstack@keystone.service[87391]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 10:00:38.060238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 10:00:38.060238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: from cryptography.utils import int_from_bytes Jul 12 10:00:38.061031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 10:00:38.061031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: from cryptography.utils import int_from_bytes Jul 12 10:00:38.061142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 10:00:38.061142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: from cryptography.utils import int_from_bytes Jul 12 10:00:38.061142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 10:00:38.061142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: from cryptography.utils import int_from_bytes Jul 12 10:00:38.109443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 10:00:38.109717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 10:00:38.109810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 10:00:38.109901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] command line args: [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 10:00:38.110010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 10:00:38.110175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 10:00:38.110276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] command line args: [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 10:00:38.110355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ================================================================================ {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 10:00:38.110484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 10:00:38.110606 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] admin_token = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.110685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ================================================================================ {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 10:00:38.110887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] config_dir = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.110968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] admin_token = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] config_dir = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] config_source = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] debug = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] config_source = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111657 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] debug = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.111948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112590 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112687 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112889 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.112986 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113184 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_config_append = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_config_append = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_dir = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_dir = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_file = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_file = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.113996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114109 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114184 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114455 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114570 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114647 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.114935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.115990 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116086 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116472 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116560 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116822 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.116991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117846 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] publish_errors = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] publish_errors = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.117962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.118908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119269 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] standard_threads = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] standard_threads = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119550 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.119893 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120008 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] use_journal = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120372 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] use_journal = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] use_json = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] use_json = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] use_stderr = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120856 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] use_stderr = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.120977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] use_syslog = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.121097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] use_syslog = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.121217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.121332 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 10:00:38.121446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.121576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.121698 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.121812 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.121930 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122149 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122441 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122542 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.122963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123592 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.123953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124370 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.124922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125499 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125845 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.125971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126570 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126693 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.126970 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127326 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.127975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128447 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128447 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128666 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.128900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129020 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129599 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.129948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.130061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.130179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.130791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.130984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131216 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.131920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132389 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.132957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133198 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133429 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133543 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.133891 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134509 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134625 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134782 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.134899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135013 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135306 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135536 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.135877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136496 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.136982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137214 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137441 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137805 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.137920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138616 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.138996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139449 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.139914 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140256 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.140967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141207 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141443 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141792 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.141908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142022 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142363 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142677 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.142958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143321 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143745 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.143972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144781 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.144896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145740 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.145856 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.146000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.146678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.146818 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.146933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.external = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.external = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.147928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148161 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.password = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.password = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148396 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] auth.token = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] auth.token = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148768 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.148974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149242 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149845 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.149961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150315 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150546 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150823 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.150952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151415 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151771 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.151888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152233 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152709 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.152940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153180 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153647 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.153888 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154607 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.154976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155344 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.155930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156165 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156281 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156402 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156518 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.156991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157106 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157409 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.157989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158582 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.158986 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.159924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160038 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160161 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160805 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.160928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161402 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.161989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.162940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163300 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163546 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163663 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163790 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.163999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164114 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164840 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.164955 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165306 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165652 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.165881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.166886 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167216 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167332 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.167923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168390 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168625 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168743 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.168980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169560 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.169916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170501 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170747 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.170992 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171109 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171337 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.171921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172035 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172264 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.172961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173084 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.173899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174014 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174358 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174480 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.174977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175091 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.175917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176035 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176264 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176493 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.176961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177077 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177314 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177546 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.177896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178137 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178480 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.178969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179094 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179331 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179494 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179614 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179834 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.179949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180372 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] role.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] role.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.180953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] role.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] role.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181300 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181415 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.181887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182002 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.182968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183314 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183666 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183783 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.183898 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184366 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184484 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184829 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.184943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185066 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.185896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186012 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186248 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.186995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187110 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187698 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.187937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188165 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.188954 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189068 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189310 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189770 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.189884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190123 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.190998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191226 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191626 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.191897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192015 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192369 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192484 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192598 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.192713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193683 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.193913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.connection = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194037 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.connection = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194646 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194822 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.194940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195054 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195169 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195527 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195755 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.195993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196110 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196338 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.196920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197504 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.197962 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.198090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.198206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.198206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 10:00:38.198422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 10:00:38.198422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 10:00:38.225055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.225284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.225513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.225598 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.225805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.226038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.234057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.234483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.262476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.262729 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.262975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.263213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.314205 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.314441 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.364427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.365189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.365993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.366231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.430417 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.430649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.430761 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.430906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.430996 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.431837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455191 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455546 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.455914 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456105 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456458 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456542 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.456896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.469213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.469577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.481806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482126 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482494 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482588 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482740 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482828 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.482966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.483063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.483181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87401) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.483275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.483453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 10:00:38.500557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.500766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 10:00:38.500988 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.501097 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.501203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 10:00:38.501547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 10:00:38.501804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.501889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 10:00:38.502102 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.502824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.503080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.514935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.515156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.515441 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.522923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.523594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.526160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.526434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.526735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.526874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.527023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527304 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.527950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528352 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528626 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.528905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.529027 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.529179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.529455 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.529455 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.555737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.556601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.557332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.557611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.558209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.558489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.562865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.563143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.563421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.563770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.564051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.564373 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.571293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.571573 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.572189 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.572470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.576162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.576447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.576728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577105 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.577286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577832 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.577916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.578100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.578185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.578383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.578657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.578954 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.596697 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.596971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.597585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.597864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.601547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.602464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.605188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.605482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.606136 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.606429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.610445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.611468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.614046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.615637 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.618328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.618624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.618932 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.619212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.619425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.619519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.619726 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.619810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.620015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.620309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.620602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.620894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.639507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.639795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.640152 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.640418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.640589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.640879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.641236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.641502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.648316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.649431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.650038 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.650308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.651248 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.651526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.653408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.653680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.653959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.654257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.654547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.654789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.655068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.655347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.655634 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.655924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.667868 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.668144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.668423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.668703 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.668983 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.669256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.669530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.669728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.670009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.670289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.670571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.670890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.671167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.671445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.688151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.690069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.691469 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.696093 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.696257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.696916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.697584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.698531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.698837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.699122 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.699204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.700823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.701100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.701390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.706518 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.708148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.708828 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.710440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.711418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.711707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.711989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.712268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.713682 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.713973 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.714257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.714537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.722496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.722806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.723082 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.724842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.725129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.725405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.730895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87401) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.731175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.731468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.731746 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.732028 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.732295 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.732565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.732829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 10:00:38.733381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733580 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.733961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87401) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.734972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.735251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.735530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.735799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.736080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.736357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.736622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.736880 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 10:00:38.773107 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56186c3099c0 pid: 87401 (default app) Jul 12 10:00:38.775855 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56186c3099c0 pid: 87402 (default app) Jul 12 10:00:38.776411 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47490261-3742-4f31-bf01-6a94f969edf2 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:38.776705 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47490261-3742-4f31-bf01-6a94f969edf2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:38.776988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47490261-3742-4f31-bf01-6a94f969edf2 None None] PATH_INFO: `/v3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:38.781221 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Tue Jul 12 10:00:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:46.741896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:46.742446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:46.742446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:46.746690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:00:46.752295 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:46.752718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:46.752847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:46.827081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: INFO dbcounter [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] Registered counter for database keystone Jul 12 10:00:46.848387 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG oslo_db.sqlalchemy.engines [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 10:00:46.854899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writer thread running {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 10:00:47.028843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG passlib.handlers.bcrypt [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87401) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 10:00:47.029189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG passlib.handlers.bcrypt [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87401) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 10:00:47.084051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:47.085635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:47.205496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 10:00:47.387347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:47.462109 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: INFO dbcounter [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] Registered counter for database keystone Jul 12 10:00:47.480728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG oslo_db.sqlalchemy.engines [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 10:00:47.486850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writer thread running {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 10:00:47.604216 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966d7a1-b2ae-4b86-b806-cf56403a7234 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:47.608475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:47.609129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:47.609411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:47.609689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:47.618197 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:47.669331 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 10:00:47.669618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fdeea-2a2f-4628-8e2c-7b892ddb4847 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:47.679537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jul 12 10:00:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 10:00:47.685470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:47.700382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402fd1b-923f-4b2d-86b7-48dfdd813002 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:47.704841 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:47.705943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:47.706238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:47.706541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] PATH_INFO: `/v3/projects/ee04a4e0146d43939fce14ce28c51a00` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:47.708255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee04a4e0146d43939fce14ce28c51a00)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:47.760936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 10:00:47.761496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3d2f6-6275-42ce-8821-492796c71e65 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:47.765861 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Tue Jul 12 10:00:47 2022] GET /identity/v3/projects/ee04a4e0146d43939fce14ce28c51a00 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:49.967719 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018ad9-7d18-468c-b5e3-00d44a20bb06 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:49.968253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018ad9-7d18-468c-b5e3-00d44a20bb06 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:49.968253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018ad9-7d18-468c-b5e3-00d44a20bb06 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:49.972384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:49.978389 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:49.978811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:49.979003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:49.997685 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:49.999267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:50.008006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 10:00:50.032321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7018ad9-7d18-468c-b5e3-00d44a20bb06 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:50.044807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7018ad9-7d18-468c-b5e3-00d44a20bb06 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:50.049023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:50.049651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:50.049938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:50.050218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:50.058435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:50.060255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f2e16-8e14-414c-89af-86acb467a46d admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:50.068975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jul 12 10:00:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 10:00:50.074264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:50.083492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ec27c-7a71-42dd-bf7d-9ffa1337875f None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:50.087849 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:50.088697 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:50.088983 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:50.089260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:50.090624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:50.092490 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e114b-a430-424b-a21e-899c7c7c3064 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:50.094035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Tue Jul 12 10:00:50 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:52.352478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4112-9d3d-4cb5-a220-7eeb8ff87349 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.352992 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4112-9d3d-4cb5-a220-7eeb8ff87349 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.353095 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4112-9d3d-4cb5-a220-7eeb8ff87349 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.354383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:00:52.359461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.359853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.360143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.376694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:52.377848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:52.406347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcd9d-52db-4f86-8e16-758c986b7379 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.406640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcd9d-52db-4f86-8e16-758c986b7379 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.406958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbcd9d-52db-4f86-8e16-758c986b7379 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.408310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:00:52.413503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.413794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.414075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.453375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG passlib.handlers.bcrypt [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87402) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 10:00:52.453805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG passlib.handlers.bcrypt [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87402) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 10:00:52.461943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:00:52.485166 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:52.499471 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:52.501071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:52.508928 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:52.604594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:00:52.628845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:52.696496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4093335-d07b-4a57-8a40-5cff3f6af375 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:52.728693 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561dce4-48da-44aa-91f9-3d7743286391 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:52.729400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:52.730198 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.730489 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.730813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.731324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:52.743979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:00:52.756140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:00:52.757157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:00:52.757959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:00:52.763273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:52.766996 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:52.767897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.768193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.768481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.851563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:52.853135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:52.860957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:52.879568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d770-605d-401e-9ba7-17cbb6ee04a2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:52.914201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:52.914889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:52.915177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:52.915450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:52.916192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:00:52.916498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:52.917911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:52.931290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:52.936445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:52.956097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 10:00:52.962190 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:52.964928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:53.037950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f24b-dd3d-4f20-9d99-ef4858a08cbc None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:53.058919 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d4e11-84b4-4b61-b21b-932d394d95fd None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:53.071673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:53.072553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:53.072846 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:53.073124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:53.074328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:53.075850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:53.077465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:00:52 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:53.082807 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:53.094125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:53.095310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:53.095599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:53.096203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:53.098308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:53.114926 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:53.116338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:00:53.139570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:00:53.140384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:00:53.141157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:00:53.141157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:00:53.141157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:00:53.141157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:00:53.141157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 9/18] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:00:53.147877 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:53.188486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97621af-74c4-4f2e-827f-436bca46f4bf None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:53.224940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:53.225756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:53.226044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:53.226326 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:53.227624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:53.229130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:53.230828 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 10/19] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:53.236904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:53.309740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:53.318763 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:53.338139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4d8bb-4bf3-4dc5-9efb-f109b4c0c133 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:53.354432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade318f-3862-4e2e-9f13-4c1b9b705a0a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:53.372722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:53.373322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:53.373612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:53.373897 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:53.374757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.domain.id=default, user.id=2e6c32588949482cbda554cc2195d9cf) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:00:53.375080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:53.376784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cf6b6-60e6-4258-a6c5-9a005a1f2e9f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:53.383497 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jul 12 10:00:53 2022] GET /identity/v3/role_assignments?user.id=2e6c32588949482cbda554cc2195d9cf&scope.domain.id=default&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:53.395980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:53.396700 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:53.396991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:53.397333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:53.398095 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:00:53.398408 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:53.399887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99b72-9cae-435d-9e77-2c28fafcf4e1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:53.420552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:55.891659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16440-8c62-42ca-8a99-d00c7bacd1f3 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:55.892732 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16440-8c62-42ca-8a99-d00c7bacd1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:55.893217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16440-8c62-42ca-8a99-d00c7bacd1f3 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:55.895232 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:55.900833 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:55.901254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:55.901433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:55.924481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:55.925686 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:56.013775 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:00:56.060044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16440-8c62-42ca-8a99-d00c7bacd1f3 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:56.222045 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16440-8c62-42ca-8a99-d00c7bacd1f3 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:56.281275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:56.282467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.283022 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.283505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.303561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b092822f-9912-4d44-90fd-07dc6c6efa3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:00:56.311714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:00:56.312540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:00:56.313291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:00:56.315987 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 13/24] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:00:56.323820 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:56.360877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb4b-6605-4ef1-9394-b28d79fa3f83 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.361499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb4b-6605-4ef1-9394-b28d79fa3f83 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.361984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cb4b-6605-4ef1-9394-b28d79fa3f83 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.363882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 14/25] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:56.369491 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70242-f207-47f7-b459-5aa620f3e10e None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.370028 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70242-f207-47f7-b459-5aa620f3e10e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.370588 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70242-f207-47f7-b459-5aa620f3e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.385624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:56.395006 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:56.412339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-2cb70242-f207-47f7-b459-5aa620f3e10e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:56.413567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-2cb70242-f207-47f7-b459-5aa620f3e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:56.492948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afeb906-4938-4bf6-a039-cfe97fe7389e None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:56.550143 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:56.551257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.552771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.553245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.554205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:00:56.554720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:56.556585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:56.578469 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 12/26] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:56.584073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:56.613048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:00:56.637568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5478b-5c41-46b3-a5b7-af07ced54d02 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.638202 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5478b-5c41-46b3-a5b7-af07ced54d02 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.638687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5478b-5c41-46b3-a5b7-af07ced54d02 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.640325 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 16/28] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:00:56.646195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.646825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.647309 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.683041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:56.684268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:56.770517 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958043-73a2-4821-abb2-6669e346e7b3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:56.789826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:56.826426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 17/29] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:00:56.828209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:56.850778 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:56.851763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.852040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.852474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.854164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:56.855839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b037a4-0db6-40ff-8e6e-dd2c077565ec None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:56.857609 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 13/30] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:00:56 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:00:56.859281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f6dab-0930-4795-87c6-09dd6ccd816e None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.859725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f6dab-0930-4795-87c6-09dd6ccd816e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.860174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f6dab-0930-4795-87c6-09dd6ccd816e None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.861541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 14/31] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:56.862664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f6dab-0930-4795-87c6-09dd6ccd816e None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:56.904541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:56.948516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc92fc-40fe-4c5b-a7ff-daa0f2c5f458 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:56.992615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:56.993664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:56.994168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:56.994656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:56.995831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:56.996709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f6dab-0930-4795-87c6-09dd6ccd816e None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:56.998118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.036827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.037864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.038301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.038807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.049734 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.051435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-b8d6d44c-14e3-43da-a5e5-9cef9025b394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:00:57.070049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:00:57.071023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:00:57.071821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:00:57.071821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:00:57.071821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:00:57.071821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:00:57.073979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 15/32] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:00:57.075394 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.075861 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.076303 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.099168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:57.100491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:57.125233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:57.150262 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 18/33] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 12 10:00:56 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:00:57.151534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.175701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 16/34] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:00:57.178740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.294672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d834-9817-4307-bf9e-1dce8770dcfa None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:57.295576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b5db-427b-452a-a9a2-2cd7b95742ef None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:57.320842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:57.332569 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.333906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.334201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.334485 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.335907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.343162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.343162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 19/35] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:57.343162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.370157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.371119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.371552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.371976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.372899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:00:57.375182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.377051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.405802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 17/36] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:57.407570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.451102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:57.498988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e92128-3727-46db-8e29-76823b7b59d7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:57.544414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.545442 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.545908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ef8e-7355-439f-86c6-cc2dd49a052a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:57.546043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.546415 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.547319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.549815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759dc70-18b9-42ec-9b29-78af49d18625 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.566561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 20/37] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:00:57.568316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b187b1-6c37-4c51-97f6-0045424086e8 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.568809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b187b1-6c37-4c51-97f6-0045424086e8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.569288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b187b1-6c37-4c51-97f6-0045424086e8 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.570810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 21/38] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:57.571741 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b187b1-6c37-4c51-97f6-0045424086e8 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.596721 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.597991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.599073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.599606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] PATH_INFO: `/v3/domains/default/users/2e6c32588949482cbda554cc2195d9cf/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.602085 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2e6c32588949482cbda554cc2195d9cf, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.604047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99451dd8-f2df-40b6-ab95-aa11c2befdb3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.649849 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:57.711032 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b187b1-6c37-4c51-97f6-0045424086e8 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:57.762642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:57.763368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.763659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.763944 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.764699 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:57.766166 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd110e1-c8e7-4dcf-a1cf-9d32e4828903 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:57.773574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 18/39] 10.222.0.44 () {58 vars in 1361 bytes} [Tue Jul 12 10:00:57 2022] PUT /identity/v3/domains/default/users/2e6c32588949482cbda554cc2195d9cf/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:00:57.775200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.775500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.775789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.796882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:57.798446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:57.801394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 22/40] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/projects => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:00:57.803282 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f95-6559-45f7-9fc5-0307808c5fcf None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.803659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f95-6559-45f7-9fc5-0307808c5fcf None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.803932 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32f95-6559-45f7-9fc5-0307808c5fcf None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.805342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 23/41] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:00:57.811260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:57.811556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:57.811848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:57.833088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:00:57.834825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:00:57.906448 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 19/42] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:00:57.932783 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 24/43] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:00:57.940144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:57.952962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:57.957220 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:58.015866 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:58.079956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942cdee-fdcf-447e-9686-2fdb89efb3d0 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:58.100077 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578d386-62c5-4e7a-977b-b6dfa9bc0cd3 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:58.128164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:58.128971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:58.129278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:58.129564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:58.130753 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:58.132440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:58.136876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 20/44] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:00:58.139595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:58.140268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:58.140553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:58.140831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:58.141743 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:58.142443 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:00:58.143358 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586946be-17ba-4369-b8fa-6991b7e69da7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:58.162770 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 25/45] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 12 10:00:57 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:00:58.233896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:00:58.261764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9449b4-1564-449d-98cc-e3a743b1bc3f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:00:58.298957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:00:58.299643 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:00:58.299934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:00:58.300217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:00:58.300948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:00:58.302494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec0cbc-2cec-40e3-b4e0-6a324ba95639 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:00:58.336998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 21/46] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:00:58 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:01:00.103493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245916c-925b-4f0c-8863-b2de2f68ff26 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.104014 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245916c-925b-4f0c-8863-b2de2f68ff26 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.104127 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245916c-925b-4f0c-8863-b2de2f68ff26 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.105447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 26/47] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:00.110735 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.111144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.111314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.128585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:00.129773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:00.196401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 22/48] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:00.220233 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245916c-925b-4f0c-8863-b2de2f68ff26 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.314352 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.324451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245916c-925b-4f0c-8863-b2de2f68ff26 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.357340 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.358064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.358353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.358636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.372219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:00.380677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:00.381476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:00.382206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:00.387369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 27/49] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:00.387874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.450293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.491900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e37f-be50-48d7-a75e-c0d98be79cf4 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.525257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.525922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.526207 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.526487 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.527261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:00.527571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.528952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e797-b9a1-4669-a263-af0f6064c541 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.537499 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 23/50] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:00.543163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.574279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4489f-69b9-407a-835f-68f8976bd0bc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.574574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4489f-69b9-407a-835f-68f8976bd0bc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.574889 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4489f-69b9-407a-835f-68f8976bd0bc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.576259 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 24/51] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:00.581016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.581303 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.581586 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.598940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:00.600171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:00.643124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c182-3c5b-4d71-9ad1-d4f6f570e488 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.665104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 25/52] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:00.676209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.677081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.677391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.677671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.678895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.680368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.681972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 28/53] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:00.687397 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.688925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.713537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.737080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.787218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b50df-dca6-413a-a43a-c7cbf48caaea None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.789931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2245-1951-452b-94cd-bbbe9be81a83 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.820124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.820939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.821235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.821521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.822722 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.823144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.823926 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.824206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.824295 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.824482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.825658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.825817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 26/54] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:00.827129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.828767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 29/55] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:00.831777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.834241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:00.929538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.933563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb5c7-b6f2-4572-bb43-fdc6895e962c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.939910 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b67a4-fe1b-4ab8-a89f-44aaf9e2cef0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:00.950143 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:00.967275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.967939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.968227 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.968506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.969337 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.domain.id=default, user.id=2e6c32588949482cbda554cc2195d9cf) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:00.969654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.971139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f7b64-d3da-4315-b6df-5b435cf8067a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.974008 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:00.974673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:00.974992 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:00.975269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:00.975973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:00.977409 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b99c53-0af5-4bd3-a1e9-e211b616bc1b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:00.979825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 27/56] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jul 12 10:01:00 2022] GET /identity/v3/role_assignments?user.id=2e6c32588949482cbda554cc2195d9cf&scope.domain.id=default&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:01.004495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 30/57] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jul 12 10:01:00 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:01:03.249990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e1dc-ae8d-4225-a779-930e37548728 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:03.250551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e1dc-ae8d-4225-a779-930e37548728 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:03.250551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e1dc-ae8d-4225-a779-930e37548728 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:03.252237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 28/58] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:03.257378 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:03.257771 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:03.257949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:03.274973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:03.276175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:03.340569 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 31/59] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:03.366116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61e1dc-ae8d-4225-a779-930e37548728 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:03.464964 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61e1dc-ae8d-4225-a779-930e37548728 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:03.497339 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:03.498122 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:03.498413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:03.498726 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:03.499906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:03.501666 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409033a7-3274-4a4a-984b-218b7a8ec119 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:03.503260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 29/60] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:03.509369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:03.577250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:03.606017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d0a3-fcc8-4104-9c05-950515ae0ff7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:03.638446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:03.639134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:03.639422 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:03.639702 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:03.640406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:03.641866 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b848f-1cca-4bca-99ed-f2d958009517 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:03.666030 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 32/61] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:03 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:07.074375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6d0e-205e-4faf-a517-4129ce120ad4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.075289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6d0e-205e-4faf-a517-4129ce120ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.075709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca6d0e-205e-4faf-a517-4129ce120ad4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.077589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 30/62] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:07.083539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeddf4-e42f-4cc9-a69e-b76da9295fc4 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.084363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeddf4-e42f-4cc9-a69e-b76da9295fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.084787 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeddf4-e42f-4cc9-a69e-b76da9295fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.107712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-6eeeddf4-e42f-4cc9-a69e-b76da9295fc4 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:07.109133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-6eeeddf4-e42f-4cc9-a69e-b76da9295fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:07.166434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162079-cb04-4e00-9415-75f53c104c51 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.167016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162079-cb04-4e00-9415-75f53c104c51 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.167449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162079-cb04-4e00-9415-75f53c104c51 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.169475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:07.174859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.175093 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.175384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.199794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:07.201022 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:07.214390 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 33/64] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:07.224155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5ae4-7b0d-4e5d-8f23-3086f9510938 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.224458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5ae4-7b0d-4e5d-8f23-3086f9510938 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.224753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5ae4-7b0d-4e5d-8f23-3086f9510938 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.226115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 34/65] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:07.231155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e6-7733-4cc4-9238-482c207d129c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.231451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e6-7733-4cc4-9238-482c207d129c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.231738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125735e6-7733-4cc4-9238-482c207d129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.260876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-125735e6-7733-4cc4-9238-482c207d129c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:07.262381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-125735e6-7733-4cc4-9238-482c207d129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:07.278543 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.304164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 32/66] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:07.305200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.318564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.333126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 35/67] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:07.343904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125735e6-7733-4cc4-9238-482c207d129c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.437691 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b5680-4daf-43c3-b9f4-4ada1f20abee None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.461529 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125735e6-7733-4cc4-9238-482c207d129c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.476668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.477759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.478198 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.478628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.492346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:07.501250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.502301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.502765 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:07.502876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:07.503868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:07.505272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:07.506206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.509652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 33/68] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:07.510653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.521722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:07.529734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:07.530839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:07.531617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:07.533868 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 36/69] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:07.534989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.568446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.592651 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.632529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4942-bf72-4190-859f-32afb70d194a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.653270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee1c03-5a89-46d9-a578-ef6719b4a725 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.671788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.672615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.672903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.673182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.683766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:07.689552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.690281 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.690573 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.690894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.691663 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:07.692006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:07.692325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:07.693103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:07.693854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:07.694414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8fbcb-b28a-491c-8945-1f1a1973d237 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:07.694477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 34/70] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:07.694477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.706741 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 37/71] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:07.708583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb17b-f74f-4c6b-b594-8d5d367eec25 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.708879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb17b-f74f-4c6b-b594-8d5d367eec25 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.709162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb17b-f74f-4c6b-b594-8d5d367eec25 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.710401 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 38/72] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:07.711347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb17b-f74f-4c6b-b594-8d5d367eec25 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.804347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.807680 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567b34-757b-4de1-98c9-8949eb3bad7a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.819630 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb17b-f74f-4c6b-b594-8d5d367eec25 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.830769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:07.840851 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.841521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.841814 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.842096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.842939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:07.843201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:07.844594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:07.853445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 35/73] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:07.854233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.856073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.856766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.857059 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.857345 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.858109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:07.858427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:07.860002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eeb6f-24ff-4676-916e-55052b9d3cca None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:07.868260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 39/74] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:07.872815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d9ff-59cf-43ba-9d37-59e76b806202 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.872815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d9ff-59cf-43ba-9d37-59e76b806202 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.872815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4d9ff-59cf-43ba-9d37-59e76b806202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.886102 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b0e4d9ff-59cf-43ba-9d37-59e76b806202 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:07.887325 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b0e4d9ff-59cf-43ba-9d37-59e76b806202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:07.954393 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 40/75] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:07.959288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697315-22a7-4531-bf06-b642852a2022 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:07.960276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148c0-7378-4d5b-80a8-dc75b08408e8 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.960576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148c0-7378-4d5b-80a8-dc75b08408e8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.961015 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148c0-7378-4d5b-80a8-dc75b08408e8 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:07.963366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 41/76] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:07.963954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec148c0-7378-4d5b-80a8-dc75b08408e8 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:07.995075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:07.995950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:07.996241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:07.996524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.012187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.013844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.015741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 36/77] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.016768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.039040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.075242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec148c0-7378-4d5b-80a8-dc75b08408e8 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.076804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.111255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.112062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.112352 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.112633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.113854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.115433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f12105-e110-4742-9388-a25af58aa739 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.117063 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 42/78] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:07 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.121707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.121804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb76099-829c-4e2a-863a-fae8a01088f3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.122195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.122195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.136100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:08.137287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:08.155321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.156201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.156490 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.156772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.157974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.159454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.161718 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 37/79] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.162387 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.210193 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 43/80] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:08.211131 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.257776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.270966 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5877f6-20e0-4548-be22-6d0d0aec08bf None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.303778 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.304573 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.304865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.305166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.314392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.315797 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:08.318234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2be9c4-6c39-4878-bbb8-4e8f8e46ab9b None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:08.323956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:08.324807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:08.325675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 38/81] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:08.326529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.354100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.354789 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.355080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.355361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.421892 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.423437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.424663 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93587098-6cfc-4acc-b8f0-624eaf6f2fb1 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.457752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.458402 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.458691 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.459007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.475989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.517142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.521019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 44/82] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:08.522031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.531274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.533032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.621821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b11a3f-72dd-4103-85d1-558bd7984e7b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.628454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 39/83] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:08.629327 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.659803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.660388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.660695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.660987 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.675463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.726277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.728752 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.729570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0198e36-33fe-41db-b2c1-b3de3dc694fa None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.730365 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.763226 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.764015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.764301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.764581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.765744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.767242 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.773593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 40/84] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.773593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.829867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 45/85] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:08.830730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.871395 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a588b2-ff1f-4bd7-a827-cc8cc733e363 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.887583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.905365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.906021 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.906307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.906583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.907385 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:08.907694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.909072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.917810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 41/86] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.918547 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:08.935298 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:08.938762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c2f7-806f-45a8-8191-5381a0377f5e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:08.974671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:08.975547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:08.975829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:08.976103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:08.977284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:08.978794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:08.980464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 46/87] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:08.986529 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.026146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701a65f-ae77-49ea-99a0-1f3fdffa5034 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.059153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.060015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.060305 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.060596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.061798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.063309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.065021 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 42/88] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:08 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.065784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.083349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc01c2b-bc70-4ae8-bed6-4a8759ef5e1a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.112321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:09.118452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.119563 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.119855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.120139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.120853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.122318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.142152 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 47/89] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:08 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:09.143090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.168423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c415-7426-477a-a534-9108f8b6b20b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.197264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:09.206659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.207649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.207942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.208258 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.209557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.211098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.213131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 43/90] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.213730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.286608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20178d-b945-4bad-b3ad-dd060734b0c9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.325133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.326018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.326331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.327305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.327973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.329602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.330494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5a290-5eea-4238-ad30-59746eb7cde0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.331465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 48/91] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.332291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.350332 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:09.376989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.378201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.378497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.378820 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.380181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:09.380503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.382096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.389596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 44/92] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=011626f50a8d4ca1b501b232111c2257 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.391316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.460457 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:09.469592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84dc43-6cf6-4b71-8e23-9da12aef9ffe None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.519690 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.521269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.521571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.521862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.522806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=2e6c32588949482cbda554cc2195d9cf) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:09.523131 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.524658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.532661 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 49/93] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/role_assignments?user.id=2e6c32588949482cbda554cc2195d9cf&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.533477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:09.534922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b83e-d01d-4a81-80bc-963b1580b458 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.578097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.578804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.579099 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.579384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.580234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] RBAC: Adding query filter params (role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:09.580554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.582042 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.588783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 45/94] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:09.675023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f197a8-1a08-4bfc-98a5-b55b4fd5fee2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:09.715454 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:09.716054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:09.716347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:09.716636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:09.747157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:09.807961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:09.809859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:09.933344 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 50/95] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:09.939047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:10.010301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:10.087434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca003ad-d069-4c47-96b7-b12e6a2f97a4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:10.138461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:10.139359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:10.139651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:10.139933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] PATH_INFO: `/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:10.143435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] RBAC: Authorizing `identity:get_project(project_id=d2b8320a15cc4e50a0de21d676e57cf8)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:10.144908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b45fa-50fe-437e-ab9a-9749025a8087 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:10.147386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 46/96] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:09 2022] GET /identity/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8 => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:10.154140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:10.239923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:10.296048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f2cc2-9750-42bd-80f0-aa800085044a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:10.340618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:10.341739 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:10.342246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:10.342791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:10.343825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=d2b8320a15cc4e50a0de21d676e57cf8, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:10.344341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:10.345995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad0b1c-f940-445d-b471-cbaa330085d2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:10.354886 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 51/97] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:10 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=d2b8320a15cc4e50a0de21d676e57cf8&role.id=011626f50a8d4ca1b501b232111c2257 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:12.537645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484f4e-4199-4894-b7b8-00fca26f0061 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.538200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484f4e-4199-4894-b7b8-00fca26f0061 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.538200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73484f4e-4199-4894-b7b8-00fca26f0061 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.539796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 47/98] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:12.545327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.545837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.545917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.563172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:12.564389 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:12.593171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164fd4-39be-41bb-bc4f-0edf68865f51 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.593506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164fd4-39be-41bb-bc4f-0edf68865f51 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.593729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64164fd4-39be-41bb-bc4f-0edf68865f51 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.595391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 48/99] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:12.605859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.606184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.606454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.630488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:12.631738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:12.685157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 52/100] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:12.724166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 49/101] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:12.728790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:12.774033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:12.789836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:12.844483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:12.882002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fafe1d-380e-411a-ac6e-a7dd6360c807 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:12.907832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956467-7e92-4eda-9d91-be70dbd11285 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:12.932633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:12.934437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.935119 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.935787 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.945236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:12.946219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.946326 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.947820 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:12.949273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76fd8d-fa19-4664-8863-cd34b2c9b73f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:12.950215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:12.950968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 50/102] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:12.955661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9187bb-63e5-42b1-b218-3da66f0f2de2 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.955661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9187bb-63e5-42b1-b218-3da66f0f2de2 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.955661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9187bb-63e5-42b1-b218-3da66f0f2de2 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.955661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 51/103] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:12.959363 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695464-7f7b-46bd-a8fe-6fb43b7af812 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.959876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695464-7f7b-46bd-a8fe-6fb43b7af812 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.960224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695464-7f7b-46bd-a8fe-6fb43b7af812 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.961728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 52/104] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:12.964082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0695464-7f7b-46bd-a8fe-6fb43b7af812 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-8a6bd04b-810f-430f-b9b3-bdd3e3ef4820 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:12.970724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:12.971632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:12.972396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:12.975385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 53/105] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:12.976867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c6ff-de3b-48ba-a182-c21c99170dfb None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:12.977362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c6ff-de3b-48ba-a182-c21c99170dfb None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:12.977857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c6ff-de3b-48ba-a182-c21c99170dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:12.995081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-fd46c6ff-de3b-48ba-a182-c21c99170dfb None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:12.996581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-fd46c6ff-de3b-48ba-a182-c21c99170dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:13.082413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0695464-7f7b-46bd-a8fe-6fb43b7af812 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.084969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 54/106] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:13.086457 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.087001 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.087506 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.100704 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.118150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:13.119410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:13.135119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.136523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.137268 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.137759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.138974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.141183 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:13.157985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.178599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 53/107] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:01:12 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:13.183322 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.214136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 55/108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:13.215101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.347388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4a06-4f44-43dd-96c4-f3c0b0dbbc58 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.349942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6efc-80a8-47df-930f-04f46fe35374 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.386678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.387410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.387682 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.387967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.388730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:13.389046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.390462 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beb0f4-b4a7-481c-a29f-183194c590ce None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:13.393121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.394218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.394726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.395801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.400369 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 54/109] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:13.401690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ed97-6ad9-43ac-9b68-289c83f49f65 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.401985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ed97-6ad9-43ac-9b68-289c83f49f65 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.402271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278ed97-6ad9-43ac-9b68-289c83f49f65 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.404008 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 55/110] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:13.404565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278ed97-6ad9-43ac-9b68-289c83f49f65 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.413515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:13.423278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:13.424109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:13.424853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:13.428672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 56/111] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:13.428672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.444097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.478869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.553517 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278ed97-6ad9-43ac-9b68-289c83f49f65 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.554922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507cc1e-18d5-484a-9667-9de5fc080413 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.596679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.597597 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.597908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.598465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.598583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.598839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.599128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.599311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.600451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.602637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bde2af-2f56-4276-a956-ce2b8602ae5e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:13.604641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 57/112] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:13.606148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.606406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.606691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.612096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:13.621381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:13.622273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:13.623015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:13.624835 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:13.625652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 56/113] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:13.626628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:13.627184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.710379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 58/114] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:13.711638 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.733354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.751236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:13.759631 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddfa52-785d-488c-bbf5-3c375cf350f8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.809266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.810907 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.811199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.811483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.812244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:13.812559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.813965 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:13.826559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 57/115] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:13.827905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.849265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe75e9-fa82-45c9-a1d6-60ee1fab2572 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.894031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.895875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.896426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.896711 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.898071 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.900178 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:13.902824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 59/116] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:13.908256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:13.950288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894839-b369-433d-8b9e-52a8738ba972 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:13.994036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:13.994604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:13.994923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:13.995203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:13.995967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:13.996284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:13.997667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.011064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 58/117] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.011064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.016225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.024528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.032132 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d6e1-6e39-4b2c-b27c-155ef1e21965 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.069298 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.070165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.070470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.070796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.081538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:14.089263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:14.090096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 60/118] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:14.095840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.121212 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7f8a2-98f7-4378-868e-281ccc472383 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.156972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.157842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.158134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.158416 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.159651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.161639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eabae-04c7-4f3e-8f6c-a2c34325e243 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.163313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 59/119] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.164493 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8643-17e9-4331-9a78-d9222af0ee15 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.164788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8643-17e9-4331-9a78-d9222af0ee15 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.165077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8643-17e9-4331-9a78-d9222af0ee15 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.166448 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 60/120] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:14.171057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8643-17e9-4331-9a78-d9222af0ee15 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.200457 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0221-656e-474c-97f3-731064209fe4 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.237902 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.239136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.239599 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.240057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/7ce6150e352c4ed7925d6778a419ed3d/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.242248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, user_id=7ce6150e352c4ed7925d6778a419ed3d, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.243970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.252114 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.261237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 61/121] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:14 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/7ce6150e352c4ed7925d6778a419ed3d/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:14.262371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.287989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.289624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8643-17e9-4331-9a78-d9222af0ee15 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.330563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.331515 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.331805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.332085 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] PATH_INFO: `/v3/users/707dbde7bb8d4b9ab462c3b187096651` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.350018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] RBAC: Authorizing `identity:get_user(user_id=707dbde7bb8d4b9ab462c3b187096651)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.351987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.355213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 61/122] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/users/707dbde7bb8d4b9ab462c3b187096651 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.356046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.395017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aced2-c1d8-4b9d-b249-3dbc904689da None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.436170 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.437535 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.438223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.438675 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.439895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:14.440722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.442850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aead23-4b78-4371-8327-d1583ba37963 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.456348 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 62/123] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.458632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.459120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.459548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.482826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:14.484367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:14.491338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcc28-7042-453e-aaf6-fef80bc5e9ba None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.528453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.537545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.538410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.538829 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.539208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.540606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.542206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.544117 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 62/124] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.545045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.563964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 63/125] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:14.565394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.595070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.652601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac0e0a-99c1-4096-8938-f077e44ef33f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.673991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7025e-558d-4470-8f20-d9c87dd6a91f None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.688349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.689167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.689559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.689946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.712837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.714022 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.714503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.715006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.716606 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.718356 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.720473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 64/126] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:14.721419 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.764542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.767439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.769064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.808166 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:14.839074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8cdda-c5c7-4135-b383-c573df981a36 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:14.878165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:14.880006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:14.880496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:14.880973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/7ce6150e352c4ed7925d6778a419ed3d/roles/91d3ea3054c242e893f97d92dc2dabb6` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:14.881574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 63/127] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:14.882542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:14.883912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, user_id=7ce6150e352c4ed7925d6778a419ed3d, role_id=91d3ea3054c242e893f97d92dc2dabb6)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:14.885873 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:14.901798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 65/128] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:14 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/7ce6150e352c4ed7925d6778a419ed3d/roles/91d3ea3054c242e893f97d92dc2dabb6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:14.903236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.008958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.012206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbdd-2ef0-4634-9664-1a5b57e5b235 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.039475 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee242eb-0612-4e5b-b232-b0e2a726c780 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.053404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.053973 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.054261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.054547 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.067855 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:15.083288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.084526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:15.084955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:15.085777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:15.086533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:15.087147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 64/129] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:15.087656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.087960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.088534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.090071 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.091824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.093971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 66/130] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:14 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:15.095013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.099379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.215473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cd664-ed68-4bf6-bc64-250926ef9d10 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.230225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109b46-d3de-4d58-8621-ab0121032b6f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.254210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.255896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.256439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.256957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.258035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:15.258653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.260313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.266463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.267516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.267650 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.267945 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.269237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.270832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.271801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 67/131] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:15.272797 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.273162 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 65/132] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:15 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:15.278577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.309140 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.347836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.387000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649130bc-9424-4f11-908e-ca6556763d70 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.389009 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d534c-a856-4a0b-8df3-97f92b601ee3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.421772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.422657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.422982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.423268 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.424597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.426072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.428392 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 66/133] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:15 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:15.429206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.437403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945e60-689d-4852-ad44-224748664557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.438596 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945e60-689d-4852-ad44-224748664557 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.439106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945e60-689d-4852-ad44-224748664557 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.439588 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945e60-689d-4852-ad44-224748664557 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/2e6c32588949482cbda554cc2195d9cf/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.441921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f945e60-689d-4852-ad44-224748664557 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, user_id=2e6c32588949482cbda554cc2195d9cf, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.443746 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f945e60-689d-4852-ad44-224748664557 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.482762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 68/134] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:15 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/2e6c32588949482cbda554cc2195d9cf/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:15.483953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945e60-689d-4852-ad44-224748664557 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.576314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.583128 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ddf2-a27d-4658-882c-a5b84ff9c8df None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.658912 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.659563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.659845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.660071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.660987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=707dbde7bb8d4b9ab462c3b187096651) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:15.661310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.662896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.674278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 67/135] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:15 2022] GET /identity/v3/role_assignments?user.id=707dbde7bb8d4b9ab462c3b187096651&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:15.715417 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945e60-689d-4852-ad44-224748664557 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.746187 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:15.759574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.760918 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.761421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.761904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] PATH_INFO: `/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.763647 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] RBAC: Authorizing `identity:get_project(project_id=d2b8320a15cc4e50a0de21d676e57cf8)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.765415 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8331892-ad9c-4d8b-927b-c8006730c6fc None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:15.767512 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 69/136] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:15 2022] GET /identity/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:15.773991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:15.895885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfb17-e500-466f-a10f-b8d5401a2715 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:15.905118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0c0-a82f-4883-9f99-fd5dc78d1d1f None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.905718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0c0-a82f-4883-9f99-fd5dc78d1d1f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.906231 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0c0-a82f-4883-9f99-fd5dc78d1d1f None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.907965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 70/137] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:15.913801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.914399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.914924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.940667 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:15.942539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:15.980510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:15.981439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:15.981762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:15.982048 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] PATH_INFO: `/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8/users/7ce6150e352c4ed7925d6778a419ed3d/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:15.992800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] RBAC: Authorizing `identity:create_grant(project_id=d2b8320a15cc4e50a0de21d676e57cf8, user_id=7ce6150e352c4ed7925d6778a419ed3d, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:15.998392 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:16.020130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 68/138] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:15 2022] PUT /identity/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8/users/7ce6150e352c4ed7925d6778a419ed3d/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:01:16.063562 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 71/139] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:16.122271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:16.150783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:16.252453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645dca-b00a-4a97-b719-4f348055e0ce None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:16.303533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:16.304377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:16.304670 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:16.304946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:16.306278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:16.307870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa358-6f16-459a-9cd2-fb091199d82a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:16.309562 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 69/140] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:16.315156 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:16.464805 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155b2e-7e29-4b0e-9109-01b6bd4e880f None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:16.501396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:16.505556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:16.506185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:16.506474 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:16.506814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:16.507561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:16.509990 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfaf3b-d179-492a-a4ea-7b77b2827dc8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:16.538807 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 72/141] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:16 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:17.237659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf314b-1de3-4fca-a7d3-f4e043ef9adc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:17.238158 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf314b-1de3-4fca-a7d3-f4e043ef9adc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:17.238232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf314b-1de3-4fca-a7d3-f4e043ef9adc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:17.240017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 70/142] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:17.245314 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:17.245723 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:17.245889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:17.263937 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:17.265114 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:17.339107 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 73/143] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:17.368121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf314b-1de3-4fca-a7d3-f4e043ef9adc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:17.483922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:17.499766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf314b-1de3-4fca-a7d3-f4e043ef9adc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:17.539649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:17.540517 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:17.540816 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:17.541097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:17.552982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:17.560727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:17.561567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:17.562311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:17.570070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:17.570892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 71/144] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:17.691252 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9e665-c639-476a-a9ed-09f45cf89122 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:17.707088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:17.744362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:17.745057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:17.745341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:17.745616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:17.746394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:17.746719 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:17.748221 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:17.763347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 74/145] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:17.768803 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:17.913906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6168c-1f11-448c-a048-3701698d2236 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:17.958826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:17.959723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:17.960130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:17.960413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:17.961636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:17.963124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:17.965079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 72/146] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:17 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:17.970395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:18.103019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0313-f400-482c-8ff4-35fb5b6b30ca None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:18.141933 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:18.142957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:18.143464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:18.143934 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:18.195267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:18.227129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:18.228923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:18.332162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 75/147] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:18.338563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:18.386341 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:18.547007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253195ab-8918-47f6-ae46-bd6416ab7548 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:18.610170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:18.611076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:18.611364 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:18.611644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:18.613032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:18.614558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c399c-4573-4ca1-bddf-27438dc92b50 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:18.617580 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 73/148] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:18 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:18.623789 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:18.743449 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:18.790333 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccd21-b84b-4225-8cdf-9fe02347f4a5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:18.834251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:18.834930 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:18.835215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:18.835492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:18.836404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:18.836724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:18.838208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210f9b0-c444-4514-8ded-60f126b8e753 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:18.844980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 76/149] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:18 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=011626f50a8d4ca1b501b232111c2257 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:19.326667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b529-8d4a-42c3-9776-8d3331dbc720 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:19.326958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b529-8d4a-42c3-9776-8d3331dbc720 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:19.327286 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44b529-8d4a-42c3-9776-8d3331dbc720 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:19.331133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 74/150] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:19.337128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce334-6890-40d4-9636-b7140b13b1ee None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:19.337924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce334-6890-40d4-9636-b7140b13b1ee None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:19.338404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce334-6890-40d4-9636-b7140b13b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:19.362925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-ed9ce334-6890-40d4-9636-b7140b13b1ee None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:19.364968 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-ed9ce334-6890-40d4-9636-b7140b13b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:19.459512 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 77/151] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:19.540207 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44b529-8d4a-42c3-9776-8d3331dbc720 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:19.665900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:19.689415 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44b529-8d4a-42c3-9776-8d3331dbc720 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:19.713777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae878d-ffe3-43c2-a39c-5c302f995cde None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:19.714268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae878d-ffe3-43c2-a39c-5c302f995cde None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:19.714843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae878d-ffe3-43c2-a39c-5c302f995cde None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:19.717709 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 78/152] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:19.725606 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aecfaf-1584-4f84-ac6f-45f7ce1eb98d None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:19.726574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aecfaf-1584-4f84-ac6f-45f7ce1eb98d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:19.727321 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aecfaf-1584-4f84-ac6f-45f7ce1eb98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:19.749189 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:19.750022 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:19.750313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:19.750596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:19.779678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:19.781511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a1aecfaf-1584-4f84-ac6f-45f7ce1eb98d None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:19.783665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a1aecfaf-1584-4f84-ac6f-45f7ce1eb98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:19.789318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:19.790156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:19.796151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:19.798346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 75/153] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:19.815211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:20.027442 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c5627-e9be-4172-9788-e12b27ef5e39 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:20.043192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:20.072979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 79/154] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:20.075309 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709345-6b96-4189-aeb8-659183191af5 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.076040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709345-6b96-4189-aeb8-659183191af5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.076720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709345-6b96-4189-aeb8-659183191af5 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.079261 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 80/155] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:20.099681 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.100407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.101087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.123438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:20.124638 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.125169 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.125642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.127215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:20.127728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:20.130636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:20.152894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 76/156] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:20.154193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:20.154806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:20.156967 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:20.181591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:20.290215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 81/157] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:20.291418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:20.444265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4034c-5469-4027-92cc-38cce2c693ed None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:20.493464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:20.516237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:20.517736 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.518240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.518761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.523601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:20.526402 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:20.529506 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 82/158] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:20 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:20.531157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:20.539891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b7d57-b4fc-4a71-a09d-b3e9301babfb None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:20.633228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:20.634744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.635204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.635625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.656346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-a4885a18-d324-436c-ab04-05cb2f6ffce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:20.667724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:20.668781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:20.669615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:20.671624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 77/159] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:20.678729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e75fd-066e-4d70-97a7-c1bf87288cc3 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.679231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e75fd-066e-4d70-97a7-c1bf87288cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.679657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e75fd-066e-4d70-97a7-c1bf87288cc3 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.681150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 78/160] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:20.682011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e75fd-066e-4d70-97a7-c1bf87288cc3 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:20.756137 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8800d9-421d-400e-9548-3d53793ba52a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:20.811209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:20.827455 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:20.829141 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:20.831445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:20.832853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:20.872569 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:20.904645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:20.906503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:20.908175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:20.912791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 83/161] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:20.916202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e75fd-066e-4d70-97a7-c1bf87288cc3 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:20.930966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:21.029908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:21.033833 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:21.036799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:21.037548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:21.111794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:21.205626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5d3-7a05-4c7f-b8e1-69e7377046a4 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:21.270142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:21.271737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:21.276541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:21.277373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:21.279142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:21.281663 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:21.286623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c470-84e3-4a5a-a13c-fd2d7208164b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:21.290623 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:21.293715 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:21.308576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 84/162] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:21.311317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:21.312090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:21.312867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:21.362737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:21.362737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:21.458648 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:21.570292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 79/163] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:21.576642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:21.599000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 85/164] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:21.602728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:21.722637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:21.771786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913738c-1c48-4c42-9c0c-2354c4815def None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:21.782970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34a13-9e44-4e62-8f78-457e7e3ed68a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:21.817990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:21.819229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:21.819649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:21.819931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:21.820843 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:21.821463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:21.823304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:21.826538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:21.827443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:21.827762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:21.828005 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] PATH_INFO: `/v3/users/2e6c32588949482cbda554cc2195d9cf` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:21.829746 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6c32588949482cbda554cc2195d9cf)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:21.831558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:21.833139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 80/165] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:21.833925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 86/166] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:21 2022] GET /identity/v3/users/2e6c32588949482cbda554cc2195d9cf => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:21.834042 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:21.834646 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:21.872409 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:21.971901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ea21-fb75-4eb6-bc24-2ccb8756aa27 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:21.972135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52897-8d3b-4c6a-84ad-b42166eafdf6 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:21.989679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.013554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.013762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.014353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.014635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.014948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.015282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.015852 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.016270 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.017845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.019508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945eff76-46c8-406c-9d52-8a80c39145f7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.021578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 81/167] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:21 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.023039 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e41a-7722-4e6d-8c0a-c3a68d23fa57 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.023569 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e41a-7722-4e6d-8c0a-c3a68d23fa57 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.024079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e41a-7722-4e6d-8c0a-c3a68d23fa57 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.025774 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 82/168] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:22.026971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2e41a-7722-4e6d-8c0a-c3a68d23fa57 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.031798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:22.040343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:22.041242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:22.041999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 87/169] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:22.042621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.149613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.157907 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2e41a-7722-4e6d-8c0a-c3a68d23fa57 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.159564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3748-4134-4130-8e63-fc51266565f9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.192718 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.193372 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.193660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.193941 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.194204 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.195102 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.195388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.195665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] PATH_INFO: `/v3/users/707dbde7bb8d4b9ab462c3b187096651` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.196871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] RBAC: Authorizing `identity:get_user(user_id=707dbde7bb8d4b9ab462c3b187096651)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.198340 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.200273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 88/170] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/users/707dbde7bb8d4b9ab462c3b187096651 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.200852 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.246795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.262016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.263531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.303971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3dcd0-f1d3-4ddc-b7dc-e2ada6ae00e1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.336843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.337493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.337775 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.338054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.338925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] RBAC: Adding query filter params (role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:22.339243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.340718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8cae2-6104-4132-af0f-016cecacbda0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.346388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 89/171] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.347576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32b70-f4e5-4519-a665-59b049542454 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.348398 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32b70-f4e5-4519-a665-59b049542454 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.348679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32b70-f4e5-4519-a665-59b049542454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.367054 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.367360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5eb32b70-f4e5-4519-a665-59b049542454 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:22.369021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5eb32b70-f4e5-4519-a665-59b049542454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:22.379405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 83/172] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:22.380717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 90/173] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589345-3319-4558-8bef-ca17a326c0b6 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589345-3319-4558-8bef-ca17a326c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db589345-3319-4558-8bef-ca17a326c0b6 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 91/174] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705bfc-7a5b-4bfa-a836-10ad6eb63a53 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.462115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705bfc-7a5b-4bfa-a836-10ad6eb63a53 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.462769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705bfc-7a5b-4bfa-a836-10ad6eb63a53 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.462769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 92/175] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:22.462769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705bfc-7a5b-4bfa-a836-10ad6eb63a53 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.506735 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd0f-dad4-47f9-8dea-efea708e73f0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.513407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.552386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.553058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.553350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.553627 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.554387 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:22.554717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.556132 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.565762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 84/176] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.567009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.599066 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705bfc-7a5b-4bfa-a836-10ad6eb63a53 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.633267 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.634076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.635050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.635328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.635629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.636816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.638313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73dd4-3bac-452e-bc94-2189e47a6de1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.640050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 93/177] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.641197 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.641482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.641759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.658425 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:22.659644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:22.678241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2158b0-d626-4c8d-aff1-228efc080b76 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.711253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.712106 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.712390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.712672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.713849 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.715345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589c84-80c2-4113-9d47-8ef140b0b5ab None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.717048 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 85/178] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.718260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.718549 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.718869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.732595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 94/179] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:22.733438 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.734593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:22.735816 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:22.773492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.804031 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 86/180] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:22.815202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.841428 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be154-fe1f-4294-99cc-2ce67cfbbeec None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.868848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:22.876348 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.877146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.877433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.877712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.878922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.880432 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.882056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 95/181] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.882814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.913278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab3dde-3f59-407f-bd9d-2e03fb35c424 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.946583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:22.947714 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:22.947995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:22.948272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] PATH_INFO: `/v3/users/7ce6150e352c4ed7925d6778a419ed3d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:22.949471 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] RBAC: Authorizing `identity:get_user(user_id=7ce6150e352c4ed7925d6778a419ed3d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:22.951020 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:22.952663 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 87/182] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/users/7ce6150e352c4ed7925d6778a419ed3d => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:22.957810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:22.987251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291bed9-1f46-4849-ad99-77dd85d99faf None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:22.989300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.023036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.023979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.024195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.024788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/707dbde7bb8d4b9ab462c3b187096651/roles/1291f72e7fd8473faa3caa9120784c53` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.026778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, user_id=707dbde7bb8d4b9ab462c3b187096651, role_id=1291f72e7fd8473faa3caa9120784c53)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.028239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.041438 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 96/183] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:22 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/users/707dbde7bb8d4b9ab462c3b187096651/roles/1291f72e7fd8473faa3caa9120784c53 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:23.042273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.064662 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82072727-6f55-42d6-a9c2-a313b0c9ba3a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.096942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.111936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.112600 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.112887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.113153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.114627 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=2e6c32588949482cbda554cc2195d9cf) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:23.114992 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.116509 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.126887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 88/184] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:22 2022] GET /identity/v3/role_assignments?user.id=2e6c32588949482cbda554cc2195d9cf&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:23.126887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.179667 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9407c4-267c-4613-b5de-27419b130fca None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.224360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.225460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.225904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.226333 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.245219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:23.256487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:23.257601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:23.258585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:23.260782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 97/185] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:23.261758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.269625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14969b-e407-46e2-954e-18b55efe0513 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.306096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.313903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.314788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.315100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.315401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.328300 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:23.337232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:23.338096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:23.338976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 89/186] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:23.341051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.412700 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.417953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d5d31-0db5-41e3-9c43-b15020aaf019 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.460160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.460838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.461125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.461406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.462233 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.463855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.468275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398a6b-b0d3-4278-b802-105ea601eb41 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.490758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 98/187] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:23 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:23.490758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.516508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.517241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.517836 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.518125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.590106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.620160 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.622385 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.633225 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e26c-d1eb-4790-a5d7-73fee447e254 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.684328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.685005 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.685604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.685727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.685819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.686378 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:23.686742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.688293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.699637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 99/188] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:23.700619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.761084 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 90/189] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:23.762111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.845253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c26939-9ef1-4489-bda2-53166b95ce1c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.887882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.888910 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.889440 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.889726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.890493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:23.890840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.892288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b6fc-94d1-4e77-ab5f-5aca42ee1d9b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:23.892796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.903324 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 100/190] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:23.904191 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.908707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:23.939461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:23.941111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:23.941702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:23.942261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:23.960202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:23.962356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:23.965912 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 91/191] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:23.967073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:23.979114 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.048425 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb87e7-e821-458a-ac58-441647e6db84 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.088313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.089189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.089564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.089848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] PATH_INFO: `/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.091144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] RBAC: Authorizing `identity:get_project(project_id=d2b8320a15cc4e50a0de21d676e57cf8)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.092724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.094446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 101/192] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/projects/d2b8320a15cc4e50a0de21d676e57cf8 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:24.098553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a663-a291-4a4a-b0e2-3207565d6260 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.099468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.138115 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.139380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.139987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.140489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.142150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.143906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.146166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 92/193] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:23 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:24.147166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.178759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.212249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a375126-8b4b-4066-a2ee-0cb3508c32ad None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.237352 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.248374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.249128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.249486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.249699 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.267184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac59de-e5c0-412d-823c-8e71fd13e58a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.318196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.318912 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.319202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.319482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.320335 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=d2b8320a15cc4e50a0de21d676e57cf8, user.id=7ce6150e352c4ed7925d6778a419ed3d) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:24.324530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.328654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.337843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.339604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.343875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 93/194] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/role_assignments?user.id=7ce6150e352c4ed7925d6778a419ed3d&scope.project.id=d2b8320a15cc4e50a0de21d676e57cf8&role.id=011626f50a8d4ca1b501b232111c2257 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:24.344728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.509022 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.562067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429864db-4aff-4e2f-bec5-17c29ed90a6c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.567116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 102/195] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:24.572838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.630839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.631726 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.632017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.632301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.649749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.756501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.757920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.762695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec4124-ddfb-4420-80f9-1961caadf753 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:24.832670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:24.833544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:24.833833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:24.834118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:24.835461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:24.836944 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:24.838859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 103/196] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:24.844318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.900922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.904852 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 94/197] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:24.912184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:24.958037 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:24.992361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f78e8-6fcd-40d1-bb0a-8e9205e3cb74 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:25.024472 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d3473-fd96-495f-bb8d-6cea69dc9375 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:25.030823 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:25.031519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:25.031839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:25.032151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:25.033139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] RBAC: Adding query filter params (role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=5c861bc50cb24ad7af5c646e77cdead5) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:25.033487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:25.035400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:25.041844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 104/198] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/role_assignments?user.id=5c861bc50cb24ad7af5c646e77cdead5&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:25.065629 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:25.067561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:25.068056 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:25.068611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:25.070273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:25.072181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12b139-ddc9-496f-8bea-a8ca19839558 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:25.074325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 95/199] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:24 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:25.081980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:25.219668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57037-0709-4788-be9b-f6d8b98bf8f1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:25.221390 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:25.264949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:25.265687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:25.265979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:25.266263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:25.267199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=5c861bc50cb24ad7af5c646e77cdead5) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:25.267521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:25.268996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6e499-1622-4361-b24a-6170f54c403f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:25.275355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 105/200] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:25 2022] GET /identity/v3/role_assignments?user.id=5c861bc50cb24ad7af5c646e77cdead5&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:26.037374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85604-56bd-458a-b52d-95bd253576a7 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.038383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85604-56bd-458a-b52d-95bd253576a7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.038928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e85604-56bd-458a-b52d-95bd253576a7 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.040625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 96/201] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:26.046328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.047239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.047808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.076715 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:26.078283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:26.179328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 106/202] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:26.215086 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85604-56bd-458a-b52d-95bd253576a7 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:26.355005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e85604-56bd-458a-b52d-95bd253576a7 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:26.365434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:26.423182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:26.424211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.424514 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.424799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.443732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-668ed827-3003-4c21-a51b-73d72e46d6e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:26.452076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:26.453001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:26.453853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 97/203] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:26.460224 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:26.602229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:26.608256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326e1d-a3b8-4a13-a3d2-5f098d6c9951 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:26.655314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489734-e894-42ec-8ed4-1b78f4d88060 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.655647 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489734-e894-42ec-8ed4-1b78f4d88060 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.655901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489734-e894-42ec-8ed4-1b78f4d88060 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.657296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 98/204] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:26.658897 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:26.659644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.659930 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.660271 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.661069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:26.661413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:26.662881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:26.672184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5449-64a6-4a23-be66-8c8bb4ef048a None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.672477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5449-64a6-4a23-be66-8c8bb4ef048a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.672940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5449-64a6-4a23-be66-8c8bb4ef048a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.675256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 107/205] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:26.681727 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:26.700556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-467a5449-64a6-4a23-be66-8c8bb4ef048a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:26.702535 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-467a5449-64a6-4a23-be66-8c8bb4ef048a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:26.779127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 99/206] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:26.780776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308d-8cb3-4a15-ad7a-72c4217b5670 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.781261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308d-8cb3-4a15-ad7a-72c4217b5670 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.781760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a308d-8cb3-4a15-ad7a-72c4217b5670 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.783241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 100/207] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:26.789293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.789806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.790275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.807743 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:26.809263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:26.824521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68432cbe-3a84-4c04-a9d2-75a2c2c06645 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:26.865618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:26.866530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:26.866891 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:26.867176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] PATH_INFO: `/v3/users/707dbde7bb8d4b9ab462c3b187096651` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:26.868505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] RBAC: Authorizing `identity:get_user(user_id=707dbde7bb8d4b9ab462c3b187096651)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:26.870081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:26.872248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 108/208] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:26 2022] GET /identity/v3/users/707dbde7bb8d4b9ab462c3b187096651 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:26.873127 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:26.889392 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 101/209] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:26.890366 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:26.903612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:26.921398 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:26.986237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939abb7-90ac-44ca-bd30-c4d0863a3155 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.001455 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c9ffe-aa03-4ccd-a3f7-ebb0bec5eda7 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.023952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.024756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.025047 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.025334 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.037058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:27.039473 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.040127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.040620 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.041046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:27.045300 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:27.046354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:27.047773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:27.050659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 109/210] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:27.051668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.115556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.117119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.145909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.147226 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.164145 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66a0-d4fe-478e-8a91-63d1d25e6411 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.200281 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.201406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.201867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.202293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.203780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.205519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.207961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 110/211] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:27.209078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.227681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 102/212] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:27.228624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.326892 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4e222-96f5-406d-8129-568a510bb53c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.335022 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f671ecb-cc00-4d7b-ad58-6426aa0f6a84 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.362732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.366661 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.367676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.368164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.368644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.370634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:27.371167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.372674 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.372979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.373534 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.373891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.374243 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.375204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.377067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.383365 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 111/213] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:27.384438 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.406605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.410817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 103/214] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:27 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:27.411892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.509972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827b947-c8fa-4524-aaf7-7661d19b51ae None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.553721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.556445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.556954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.557659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.560273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.562839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.565095 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 112/215] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:27.572865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.581305 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede82ce-c786-44c5-abf9-98486331e03e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.637079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.637868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.638152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.638425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] PATH_INFO: `/v3/users/bdd0ee1549de412a893ec068d31346a2` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.667772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] RBAC: Authorizing `identity:get_user(user_id=bdd0ee1549de412a893ec068d31346a2)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.669550 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.671082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 104/216] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/users/bdd0ee1549de412a893ec068d31346a2 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:27.676337 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.676618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:27.696234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5590-e562-42d1-b75d-30ca8264626d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.735732 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.736909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.737526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.738009 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.739211 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3, user.id=707dbde7bb8d4b9ab462c3b187096651) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:27.739782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.741787 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a7d9-382d-4dc8-aea2-4b734d91e682 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.749242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 113/217] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/role_assignments?user.id=707dbde7bb8d4b9ab462c3b187096651&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:27.750286 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:27.824196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d814cf-aba3-4cd1-81b6-a99a4e11ce6c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:27.862966 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:27.863708 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.863997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.864280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.949686 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849393b7-31f4-4784-84d3-5458164b6b68 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.949869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849393b7-31f4-4784-84d3-5458164b6b68 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.950155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849393b7-31f4-4784-84d3-5458164b6b68 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.951621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 114/218] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:27.958328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:27.958695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:27.958951 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:27.959443 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:27.961144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:27.978203 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:27.979431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:28.006449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.066003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 115/219] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:28.073418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 105/220] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:28.078896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.091720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.178328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.203182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553b7fa-ef8a-4103-a2c1-250918f9cab7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.216333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf5b8d-86e9-4729-bae9-670be4a84d2b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.244572 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.245837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.246313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.246808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.248400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:28.250218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b552-dc66-485b-b8c6-0c68d04dd714 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:28.253605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 116/221] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:28.256504 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5933e4-5fd9-43b0-b5d7-7e1746604eea None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.256994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5933e4-5fd9-43b0-b5d7-7e1746604eea None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.257479 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5933e4-5fd9-43b0-b5d7-7e1746604eea None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.259210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 117/222] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:28.263114 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5933e4-5fd9-43b0-b5d7-7e1746604eea None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.266660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.268563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.268842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.269124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.279296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.283327 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-11f9f18d-69ab-4d29-b238-501e167caff8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:28.296081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:28.297150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:28.297899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:28.301506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 106/223] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:28.307057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.307057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.307057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.327586 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:28.329197 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:28.398862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5933e4-5fd9-43b0-b5d7-7e1746604eea None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.426140 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 107/224] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:28.427276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.438148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.439085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.439571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.440065 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.441092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=bdd0ee1549de412a893ec068d31346a2) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:28.442194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:28.444091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:28.451301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 118/225] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/role_assignments?user.id=bdd0ee1549de412a893ec068d31346a2&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=011626f50a8d4ca1b501b232111c2257 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:28.466815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.479357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.566316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68475a-530b-4beb-9672-0a665feb79e6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.604959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.605298 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547c76-3d61-4993-a23d-b3ad8d04c472 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.605650 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.605940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.606221 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.607050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:28.607366 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:28.608874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:28.619006 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 108/226] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:28.620362 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.624474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.671389 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.672194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.672484 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.672768 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.698199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:28.712217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:28.713092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:28.714287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:28.722230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 119/227] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:28.723117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.789747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b698fd-31f1-468b-a3a9-32331c94e969 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.825223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:28.826121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:28.826413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:28.826696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:28.827957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:28.829418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:28.831423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 109/228] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:28.837417 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:28.935197 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.944747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a770e84-e046-4e05-856a-a293203a298b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:28.952502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:28.986557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43787a96-bf82-464d-810f-1b316029f778 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:29.008233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.009167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.009452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.009785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.011250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.012665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.014458 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 110/229] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:29.024354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:29.028998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.030000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.030855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.032111 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.033091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:29.035095 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.040515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.056357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 120/230] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:29.067469 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:29.147702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d209-c0b2-4abe-919c-bc6f4a2b81e6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:29.182608 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:29.187725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.188630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.188920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.189201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/5c861bc50cb24ad7af5c646e77cdead5/roles/91d3ea3054c242e893f97d92dc2dabb6` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.193723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, user_id=5c861bc50cb24ad7af5c646e77cdead5, role_id=91d3ea3054c242e893f97d92dc2dabb6)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.195917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.219435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 111/231] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:29 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/5c861bc50cb24ad7af5c646e77cdead5/roles/91d3ea3054c242e893f97d92dc2dabb6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:29.279533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9039c-d929-4869-b8c3-7a269953c7c4 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:29.340252 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:29.355716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.356636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.356921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.357199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.358530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.360061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.362055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 121/232] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:29 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:29.368843 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:29.532438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920857-37f1-4acf-b0c4-b7372a5890ce None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:29.577119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.578352 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.578876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.579357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.580832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.583214 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d35f4-3f34-42ad-a43a-d6b6f1cbb5ac None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.585134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 112/233] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:29 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:29.590789 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:29.726525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d8aaf-b061-476f-bdf5-e05e2f76054f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:29.772010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:29.772920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:29.773206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:29.773487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/5c861bc50cb24ad7af5c646e77cdead5/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:29.775626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, user_id=5c861bc50cb24ad7af5c646e77cdead5, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:29.777103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742e2e3-9d09-4e0f-85f2-e3b65751d460 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:29.801617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 122/234] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:29 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/5c861bc50cb24ad7af5c646e77cdead5/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:30.576716 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba72-2f1d-4165-8dd0-e92e4ac7eddf None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:30.577740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba72-2f1d-4165-8dd0-e92e4ac7eddf None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:30.578259 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbba72-2f1d-4165-8dd0-e92e4ac7eddf None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:30.579899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 113/235] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:30.585942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9d6d-724c-463b-951c-fcc5c63d93f6 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:30.586368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9d6d-724c-463b-951c-fcc5c63d93f6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:30.586544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9d6d-724c-463b-951c-fcc5c63d93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:30.606818 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-52ea9d6d-724c-463b-951c-fcc5c63d93f6 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:30.608013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-52ea9d6d-724c-463b-951c-fcc5c63d93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:30.680909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:30.695878 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 123/236] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:30.744245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbba72-2f1d-4165-8dd0-e92e4ac7eddf None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:30.821870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:30.883020 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda456-0c67-47d0-b227-98bb0a3641b2 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:30.883360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda456-0c67-47d0-b227-98bb0a3641b2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:30.883613 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fda456-0c67-47d0-b227-98bb0a3641b2 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:30.885347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbba72-2f1d-4165-8dd0-e92e4ac7eddf None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:30.886524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 124/237] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:30.891116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:30.891676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:30.892168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:30.913269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:30.915933 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:30.925055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:30.925055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:30.925055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:30.925055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:30.943734 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:30.951845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:30.952705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:30.953470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:30.954858 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 114/238] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:30.965556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.051294 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 125/239] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:31.086061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.155738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c0b6-70ee-4560-a35a-dab10f7df724 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.173400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.194637 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.195284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.195570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.195848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.196725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:31.197063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.198584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8300469-cf78-4ebc-a3d7-26773c5126e9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.208187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 115/240] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:31.209595 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488b85-e563-4ac5-aba5-d06e1b2975bf None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.209890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488b85-e563-4ac5-aba5-d06e1b2975bf None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.210167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488b85-e563-4ac5-aba5-d06e1b2975bf None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.216324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 116/241] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:31.217100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488b85-e563-4ac5-aba5-d06e1b2975bf None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.235855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd494e-231f-4f8d-a201-6eb0f73ce19a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.262807 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.282335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.283172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.283450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.283728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.284911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.286628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c8fcf-cc4f-40f9-af1b-7ec21b3a0698 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.288305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 126/242] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:31.289938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.290122 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.290376 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.307294 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:31.308578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:31.336912 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488b85-e563-4ac5-aba5-d06e1b2975bf None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.390726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 127/243] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:31.390726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.407445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.408361 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.408655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.408942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] PATH_INFO: `/v3/users/0f4ec9fb18d848b69e194532caf3dc4c` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.427905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] RBAC: Authorizing `identity:get_user(user_id=0f4ec9fb18d848b69e194532caf3dc4c)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.429378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.431317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 117/244] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/users/0f4ec9fb18d848b69e194532caf3dc4c => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:31.436305 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.472077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.528619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a445f-f068-4cdc-a50d-49991ce017ee None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.548513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.552144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5760-d864-4e8f-8bd6-ec7edcffd682 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.571527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.572218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.572503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.572784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.573623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.575138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.596515 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.597468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 128/245] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:31 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:31.599353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.599870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.600347 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.603920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.612719 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:31.621344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:31.622262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:31.623096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:31.626102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 118/246] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:31.632487 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.737467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.744490 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ef81-b615-42c2-a4ce-ab911e547c35 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.782975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.784085 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.784574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.785108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.786245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:31.786787 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.788398 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.798404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 119/247] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:31.804881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:31.844790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301cd16-4214-4cb6-83d4-4ee2fb748797 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.920668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4411de-d64c-415c-b912-b981e8aaf824 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:31.923060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.924198 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.924493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.924830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.967267 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:31.968702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:31.969283 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:31.969781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] PATH_INFO: `/v3/users/bdd0ee1549de412a893ec068d31346a2` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:31.971236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] RBAC: Authorizing `identity:get_user(user_id=bdd0ee1549de412a893ec068d31346a2)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:31.972971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:31.974977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 120/248] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/users/bdd0ee1549de412a893ec068d31346a2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:31.979055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:31.982038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.010255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.011863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d042-5f06-4fb8-89d6-a80ca4e3bf22 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.015687 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:32.113826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de2ec-7905-4935-a47a-ae39703e73ce None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.132074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 129/249] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:32.133447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5aa3-6795-4c0e-a1a2-3f3b59f143eb None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.133744 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5aa3-6795-4c0e-a1a2-3f3b59f143eb None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.134030 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5aa3-6795-4c0e-a1a2-3f3b59f143eb None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.135355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 130/250] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:32.137691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5aa3-6795-4c0e-a1a2-3f3b59f143eb None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.161781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.162653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.162977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.163257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.164461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.165919 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579199f-f92d-4b3d-9302-6a005075075a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.167852 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 121/251] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:31 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:32.169068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.169409 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.169699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.187917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:32.189121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:32.235358 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:32.265070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5aa3-6795-4c0e-a1a2-3f3b59f143eb None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.278176 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 122/252] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:32.279314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.304052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.304923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.305647 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.305950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.307501 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.309165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.312684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 131/253] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:32.313788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:32.318161 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.394218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806e6c-d6db-40fd-bb35-c70f54fd6ed1 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.431878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.432841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.433133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.433413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/bdd0ee1549de412a893ec068d31346a2/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.439597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, user_id=bdd0ee1549de412a893ec068d31346a2, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.441066 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.448175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840d11-5553-4a48-a389-84963d41b73f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.477400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 123/254] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:32 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/bdd0ee1549de412a893ec068d31346a2/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:32.478318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.497080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.498303 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.502931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.503621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.532374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:32.553073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:32.554021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:32.554817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:32.558223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 132/255] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:32.564351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.570405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:32.655037 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:32.684353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e0462-b797-4519-aff9-f397bce79f34 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.728374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.729055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.729342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.729622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.730467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=0f4ec9fb18d848b69e194532caf3dc4c) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:32.730834 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.732311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc5958-1944-4c04-84b9-37188c222df2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.739330 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 124/256] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/role_assignments?user.id=0f4ec9fb18d848b69e194532caf3dc4c&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:32.740783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea46b-67f7-4b1e-81ca-deed42904d0a None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.741079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea46b-67f7-4b1e-81ca-deed42904d0a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.741361 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdea46b-67f7-4b1e-81ca-deed42904d0a None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.743042 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 125/257] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:32.748817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.749403 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.749789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.773431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:32.775041 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:32.780975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4990f-57ba-4194-ac7c-c829d6161f93 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:32.861653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 126/258] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:32.888809 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:32.890561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:32.891431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:32.891859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:32.892302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:32.893259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:32.893748 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:32.895412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:32.913211 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 133/259] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:32.922809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.042179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:33.055077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:33.110969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec99bc-15dd-47fe-8527-5e17915efae3 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.117753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131162-40e0-486d-9c22-2bce4d92612c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.161706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.162598 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.162913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.163193 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.164697 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:33.167628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:33.170452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 134/260] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:33.176564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.207553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.208619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.209054 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.209504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.230291 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:33.246925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:33.248024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:33.249010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:33.251362 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 127/261] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:33.257730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.359431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee400c-5a03-414d-9b7b-ccc094ccca75 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.420421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:33.427338 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.427998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.428283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.428564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.501360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:33.502879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:33.516610 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54704-81fd-4ff2-bbe8-e6933146e4f3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.574240 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.574934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.575224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.575508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.576271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:33.576575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:33.578101 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:33.583798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:33.593385 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 128/262] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:33.599516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.717390 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 135/263] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:33.722351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.725760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366abd-a6c0-425a-bc74-595663a10950 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.760973 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.761859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.762149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.762435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] PATH_INFO: `/v3/users/5c861bc50cb24ad7af5c646e77cdead5` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.763695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] RBAC: Authorizing `identity:get_user(user_id=5c861bc50cb24ad7af5c646e77cdead5)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:33.765175 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:33.767180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 129/264] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/users/5c861bc50cb24ad7af5c646e77cdead5 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:33.772644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:33.780102 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:33.919620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d3e5-4f1d-4fd4-90ff-b2bc4ff4ed76 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:33.973089 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:33.973876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:33.974543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:33.974543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:33.982424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:33.982424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:33.986727 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 136/265] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:33.989797 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:34.020885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:34.131967 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc1fbb-6a27-4d4c-846e-c5c57fce9440 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:34.135085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:34.189668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:34.190401 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:34.190691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:34.191003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:34.192313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] RBAC: Adding query filter params (role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=5c861bc50cb24ad7af5c646e77cdead5) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:34.192631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:34.194146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:34.200728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 137/266] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/role_assignments?user.id=5c861bc50cb24ad7af5c646e77cdead5&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:34.204654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43c28-35a4-4012-b1a3-c0aace2c5d08 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:34.291826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:34.292408 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:34.292693 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:34.292969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:34.402860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:34.404343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:34.501935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:34.547790 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 130/267] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 10:01:34.553237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:34.686615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07909ed6-d6ff-48b4-a4f2-f9634a6d28e7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:34.729396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:34.730611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:34.731122 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:34.731624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:34.734573 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:34.736303 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f475dac-6aab-43e0-bfc7-3c69ae0e1b2e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:34.739119 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 138/268] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:34 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:34.746226 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:34.889456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a0a15-2a73-4639-8a6f-302bf27b6912 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:34.940571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:34.941294 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:34.941568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:34.941847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:34.942687 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=5c861bc50cb24ad7af5c646e77cdead5) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:34.943027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:34.944486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb82f30-e097-4eb7-842e-a6e1e30b34ff None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:34.955807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 131/269] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:34 2022] GET /identity/v3/role_assignments?user.id=5c861bc50cb24ad7af5c646e77cdead5&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:35.140185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aee20-41d9-4f13-8028-0db1510e91fd None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.140672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aee20-41d9-4f13-8028-0db1510e91fd None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.140672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aee20-41d9-4f13-8028-0db1510e91fd None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.142024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 139/270] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:35.148171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a552-322d-4a3b-9926-74b1a638180a None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.148467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a552-322d-4a3b-9926-74b1a638180a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.148776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a552-322d-4a3b-9926-74b1a638180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.169297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-3ec4a552-322d-4a3b-9926-74b1a638180a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:35.170866 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-3ec4a552-322d-4a3b-9926-74b1a638180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:35.202079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.254848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 132/271] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:35.275461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aee20-41d9-4f13-8028-0db1510e91fd None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.310290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.386170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaabd4-8562-425f-8c32-d2c02f5f2aa4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.386487 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaabd4-8562-425f-8c32-d2c02f5f2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.386756 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaabd4-8562-425f-8c32-d2c02f5f2aa4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.394264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aee20-41d9-4f13-8028-0db1510e91fd None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:35.398767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 133/272] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:35.402376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.402949 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.403433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.423117 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:35.424630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:35.436509 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:35.437372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.437662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.437943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.450334 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:35.459938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:35.460834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:35.461618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:35.466156 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 140/273] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:35.469831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.520491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 134/274] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:35.550454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.580743 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.591708 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3463ea-d089-41b7-b31d-93ddccaa56c2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:35.632758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:35.633440 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.633729 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.634012 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.634802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:35.635120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:35.636748 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:35.646876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 141/275] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:35.656038 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.668424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.679210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4ec6-be91-40ab-b6f8-e7a13372d215 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:35.714505 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:35.715340 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.715626 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.715910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.717072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:35.718549 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdeec1-e88a-457e-9e4d-a94b66892f7c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:35.720194 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 135/276] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:35.721380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5568c6-5f6c-4173-b43c-2ba68ecd3a2b None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.721663 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5568c6-5f6c-4173-b43c-2ba68ecd3a2b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.721937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5568c6-5f6c-4173-b43c-2ba68ecd3a2b None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.723889 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 136/277] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:35.727830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5568c6-5f6c-4173-b43c-2ba68ecd3a2b None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.779214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff2de0-430c-47d9-bc56-dd836ec48900 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:35.815890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:35.817505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.818033 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.818449 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] PATH_INFO: `/v3/users/607130a8e5cb416093b2196f30196b6c` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.833164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] RBAC: Authorizing `identity:get_user(user_id=607130a8e5cb416093b2196f30196b6c)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:35.834695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f60da-ce40-438e-bfe7-c9d2f454fffe None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:35.836413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 142/278] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/users/607130a8e5cb416093b2196f30196b6c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:35.836660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5568c6-5f6c-4173-b43c-2ba68ecd3a2b None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:35.837609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.837899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.838181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.855437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:35.856637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:35.864175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.879341 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:35.880053 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:35.880336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:35.880662 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:35.881370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:35.883099 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:35.918848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 137/279] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:01:35 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:35.918848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:35.939478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:35.948929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 143/280] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:35.975495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.038141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c59-a730-4a93-903a-5d3fd986124a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.091818 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.092657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.092950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.093227 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.094081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, user.id=607130a8e5cb416093b2196f30196b6c, scope.system=all) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:36.094403 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.095960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cbab8-0823-48da-8664-0baa6fc1eac1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.102294 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 138/281] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/role_assignments?user.id=607130a8e5cb416093b2196f30196b6c&scope.system=all&role.id=011626f50a8d4ca1b501b232111c2257 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:36.103678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05f7c-2373-40d2-a941-f51f1fdea6a2 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.104164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05f7c-2373-40d2-a941-f51f1fdea6a2 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.104451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a05f7c-2373-40d2-a941-f51f1fdea6a2 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.105983 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 139/282] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:36.112756 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848c30-3d24-490c-b431-409926a89bab None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.113280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848c30-3d24-490c-b431-409926a89bab None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.113764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1848c30-3d24-490c-b431-409926a89bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.119714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4c34-a950-4448-a163-2002173f634e None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.133740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-c1848c30-3d24-490c-b431-409926a89bab None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:36.134994 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-c1848c30-3d24-490c-b431-409926a89bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:36.161935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.163442 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.164417 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.164417 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.181620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:36.189791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:36.190774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:36.197091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 144/283] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:36.198078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.203113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.235897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 140/284] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:36.263063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1848c30-3d24-490c-b431-409926a89bab None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.281350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.327013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4681-54cf-45dd-8b51-664cfcea4d0b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.378786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.378786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.378786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.378786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.379725 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:36.379725 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.379725 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.388788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 145/285] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:36.393722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.414381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1848c30-3d24-490c-b431-409926a89bab None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.457209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.457965 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.458250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.458526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.471359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:36.479131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:36.479985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:36.480864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:36.482498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.482570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 141/286] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:36.487721 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.532463 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9d99-49ae-42df-af90-f7345dd162fb None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.576488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.577366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.577646 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.577920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] PATH_INFO: `/v3/users/0f4ec9fb18d848b69e194532caf3dc4c` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.581397 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] RBAC: Authorizing `identity:get_user(user_id=0f4ec9fb18d848b69e194532caf3dc4c)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.582944 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.589121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 146/287] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/users/0f4ec9fb18d848b69e194532caf3dc4c => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:36.594628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.636571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.672055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772027c-e04a-4025-b9ca-2e311e291615 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.724037 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.724628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.724910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.725186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.725933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:36.726239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.734395 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.755808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 142/288] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:36.761051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.851050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916b62-7ba6-4852-9e52-a9558c6ce05d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.887200 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.897865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.898751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.899040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.899315 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.902532 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb05a1b-3a15-4aa8-a603-f7b26ae4243d None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:36.904798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.906395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.908150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 147/289] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:36.914341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:36.951102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:36.966460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:36.968270 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:36.968929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:36.970510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] PATH_INFO: `/v3/users/bdd0ee1549de412a893ec068d31346a2` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:36.972157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] RBAC: Authorizing `identity:get_user(user_id=bdd0ee1549de412a893ec068d31346a2)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:36.976223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:36.979315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 143/290] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/users/bdd0ee1549de412a893ec068d31346a2 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:36.985030 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:37.105770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4db61f-b7ca-4fb3-92f0-8ca61a420adc None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:37.124918 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3947-9f03-4b01-a837-b5bfd7b8cf45 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:37.170316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:37.170998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:37.171287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:37.171568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:37.191247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:37.192153 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:37.192436 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:37.192717 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/0f4ec9fb18d848b69e194532caf3dc4c/roles/1291f72e7fd8473faa3caa9120784c53` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:37.195994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, user_id=0f4ec9fb18d848b69e194532caf3dc4c, role_id=1291f72e7fd8473faa3caa9120784c53)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:37.197465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:37.219662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 148/291] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:01:36 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/users/0f4ec9fb18d848b69e194532caf3dc4c/roles/1291f72e7fd8473faa3caa9120784c53 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:01:37.287103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:37.288991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:37.291482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:37.419575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 144/292] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:37.425406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:37.509692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:37.565307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b44-21a9-432f-893d-b02c2cd5322f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:37.617238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:37.618110 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:37.618394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:37.618672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:37.619904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:37.621355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3cc4-615c-4fb6-aa54-207e670cb421 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:37.623374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 149/293] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:37 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:37.630469 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:37.770788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:37.778985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6bb9-ca70-4efd-b10d-e425851c6de6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:37.823557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:37.824142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:37.824428 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:37.824709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:37.825541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=bdd0ee1549de412a893ec068d31346a2) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:37.825860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:37.827338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838709fd-098b-4d88-b2ae-1b040fc0eac7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:37.833767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 145/294] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:37 2022] GET /identity/v3/role_assignments?user.id=bdd0ee1549de412a893ec068d31346a2&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=011626f50a8d4ca1b501b232111c2257 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:38.648623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a77b-3bd1-43bc-a2f7-b6ef4f764f80 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:38.649112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a77b-3bd1-43bc-a2f7-b6ef4f764f80 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:38.649112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0a77b-3bd1-43bc-a2f7-b6ef4f764f80 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:38.650764 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 150/295] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:38.656266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:38.656656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:38.656820 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:38.673609 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:38.674835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:38.722975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a60e9-c6af-496d-83b9-2f591e8cc046 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:38.723277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a60e9-c6af-496d-83b9-2f591e8cc046 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:38.723549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a60e9-c6af-496d-83b9-2f591e8cc046 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:38.724935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 151/296] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:38.729853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:38.730146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:38.730433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:38.748940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:38.750408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:38.750959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 146/297] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:38.775276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:38.836680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 152/298] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:38.862780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:38.898780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:38.908286 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28a7d-bebf-4ccd-91a4-8d53981a3c83 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:38.931118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:38.955931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:38.956760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:38.957053 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:38.957333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:38.968324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:38.976613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:38.977464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:38.978244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:38.983011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 147/299] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:38.983972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:38.991617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff47fa-b4c5-4241-a14e-a50869385aa5 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.039869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.040514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.040799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.041078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.052935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-25fbd413-dd4e-4688-a0c3-edbc24cd69ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:39.060726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:39.061574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:39.062814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 153/300] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:39.063692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d063-5046-47de-adaa-7ae1960ae86d None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.063928 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d063-5046-47de-adaa-7ae1960ae86d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.064077 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d063-5046-47de-adaa-7ae1960ae86d None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.065499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 154/301] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:39.070654 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d063-5046-47de-adaa-7ae1960ae86d None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.095762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854b15-41c3-4878-828b-dba4fc31b518 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.133074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.133743 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.134033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.134312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.135102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:39.135415 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.136823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27a031-d44c-4cc6-bc7f-0593cb410fc0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.145866 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 148/302] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.149088 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.149418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.149806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.170676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:39.172602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:39.181608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d063-5046-47de-adaa-7ae1960ae86d None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.186870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.201072 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.224233 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.224906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.225194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.225533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.226222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] RBAC: Adding query filter params (name=reader) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:39.226537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.228072 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.239275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 155/303] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.241100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.249653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 149/304] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:39.251590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.361742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed46e9-003a-4271-ae8a-ad03e0fecbca None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.366047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd7e1-1794-4156-93f8-b8f6e13c20a4 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.402311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.403159 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.403444 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.403719 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] PATH_INFO: `/v3/users/607130a8e5cb416093b2196f30196b6c` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.405106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=607130a8e5cb416093b2196f30196b6c)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.407003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.407765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.408639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.409113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 156/305] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/users/607130a8e5cb416093b2196f30196b6c => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.410565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.412748 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.413494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] PATH_INFO: `/v3/users/8c6c93c6aaec487caa5dd11619aa9886` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.429221 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=8c6c93c6aaec487caa5dd11619aa9886)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.430696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.436929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 150/306] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/users/8c6c93c6aaec487caa5dd11619aa9886 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.436929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.438738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.468018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.522825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5a9be-5c9a-460e-854b-552971a0f9c6 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.543007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa04f-ab52-4291-84ac-2acca3486ac0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.558074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.558942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.559230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.559510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.560785 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.562301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.568753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 157/307] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.568753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.586854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.587731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.588017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.588301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] PATH_INFO: `/v3/system/users/607130a8e5cb416093b2196f30196b6c/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.589836 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=607130a8e5cb416093b2196f30196b6c, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.591272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.601453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 151/308] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jul 12 10:01:39 2022] PUT /identity/v3/system/users/607130a8e5cb416093b2196f30196b6c/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:39.607974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:39.703515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db4766-a614-4261-bf2c-3fa2a03f66fa None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.705763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.726435 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:39.748287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.748504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78370d0-460f-44c8-bb3e-5ac950ea619f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:39.748953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.749235 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.749511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.750473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, user.id=8c6c93c6aaec487caa5dd11619aa9886, scope.system=all) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:39.751186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.752730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce1c13-5265-4fc0-a36d-e30edb96cbff None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.759177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 158/309] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/role_assignments?user.id=8c6c93c6aaec487caa5dd11619aa9886&scope.system=all&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:39.760373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193c3fe-7168-471e-8932-426e94055dc6 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.760665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193c3fe-7168-471e-8932-426e94055dc6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.760939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193c3fe-7168-471e-8932-426e94055dc6 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.762510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 159/310] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:39.768592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.768787 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.768989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.788482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:39.789710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:39.802914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:39.803847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:39.804138 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:39.804528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] PATH_INFO: `/v3/groups` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:39.805281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:39.806867 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:39.844437 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 152/311] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jul 12 10:01:39 2022] POST /identity/v3/groups => generated 229 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:39.886003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 160/312] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:39.912471 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:40.032529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c158b-2018-48a9-b050-2e6979519b38 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:40.065081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:40.076400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:40.077209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:40.077503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:40.077780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:40.088401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:40.096393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:40.097262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:40.098065 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 153/313] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:40.103665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:40.219271 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063e0b-60f2-42b5-85c9-9e5bfbbd3fa7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:40.231098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:40.258443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:40.259146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:40.259432 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:40.259768 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:40.260527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] RBAC: Adding query filter params (name=reader) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:40.260835 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:40.262227 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:40.271272 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 161/314] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:40.276697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:40.386049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719aa4f-a09a-4b34-b5d8-969690b1c509 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:40.425047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:40.426471 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:40.426783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:40.427068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] PATH_INFO: `/v3/users/0f4ec9fb18d848b69e194532caf3dc4c` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:40.428293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] RBAC: Authorizing `identity:get_user(user_id=0f4ec9fb18d848b69e194532caf3dc4c)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:40.429757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:40.431432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 154/315] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:40 2022] GET /identity/v3/users/0f4ec9fb18d848b69e194532caf3dc4c => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:40.437105 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:40.544564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e8d54-23c0-4803-86a2-e44092003aab None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:40.580333 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:40.580986 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:40.581275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:40.581557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:40.626625 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:40.664900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:40.666326 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:40.770441 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 162/316] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:40.775838 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:40.834123 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:40.883341 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30223a19-cf16-4b23-a621-efe0eab5a52f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:40.917632 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:40.918546 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:40.918925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:40.919209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:40.920533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:40.922216 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735ff6d-3e65-4433-a5b2-2857f0a73415 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:40.924517 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 155/317] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:40 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:40.932118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:41.008343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:41.045621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc374-e006-43b5-83f7-81d4d83ce4b9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:41.082387 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:41.083130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:41.083424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:41.083701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:41.084540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429, user.id=0f4ec9fb18d848b69e194532caf3dc4c) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:41.084857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:41.086319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaba1db-184c-4f65-9554-673937b4c331 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:41.092526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 163/318] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:01:40 2022] GET /identity/v3/role_assignments?user.id=0f4ec9fb18d848b69e194532caf3dc4c&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:41.935308 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a38b1-f88e-4dbc-a0ff-dc5d64c73f18 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:41.935821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a38b1-f88e-4dbc-a0ff-dc5d64c73f18 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:41.935895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a38b1-f88e-4dbc-a0ff-dc5d64c73f18 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:41.937363 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 156/319] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:41.942890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0002-1cde-42d7-a6e1-64bb4002a88f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:41.943277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0002-1cde-42d7-a6e1-64bb4002a88f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:41.943459 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0002-1cde-42d7-a6e1-64bb4002a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:41.960739 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4dca0002-1cde-42d7-a6e1-64bb4002a88f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:41.961915 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4dca0002-1cde-42d7-a6e1-64bb4002a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:42.034116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 164/320] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:42.057667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a38b1-f88e-4dbc-a0ff-dc5d64c73f18 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.151811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d213-aa59-4a90-84f7-1c127f2f11d0 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.152106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d213-aa59-4a90-84f7-1c127f2f11d0 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.152377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d213-aa59-4a90-84f7-1c127f2f11d0 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.154030 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 165/321] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:42.158790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabaf4-4409-47ce-a80c-eff6d17757b3 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.159158 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabaf4-4409-47ce-a80c-eff6d17757b3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.159513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efabaf4-4409-47ce-a80c-eff6d17757b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.169033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a38b1-f88e-4dbc-a0ff-dc5d64c73f18 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.176830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-8efabaf4-4409-47ce-a80c-eff6d17757b3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:42.177989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-8efabaf4-4409-47ce-a80c-eff6d17757b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:42.194762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.208984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.209784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.210071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.210355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.221432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-72ecb4c8-03a6-4f70-993a-db3a85e3d7f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:42.229804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:42.230768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:42.231577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 157/322] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:42.232432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3d81-cc4e-44c3-be30-dd5a2f0f96e6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.232716 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3d81-cc4e-44c3-be30-dd5a2f0f96e6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.232994 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3d81-cc4e-44c3-be30-dd5a2f0f96e6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.234293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 158/323] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:42.236736 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3d81-cc4e-44c3-be30-dd5a2f0f96e6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.247277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.255111 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 166/324] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:42.256370 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.256644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.256926 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.275679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:42.276861 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:42.338508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3d81-cc4e-44c3-be30-dd5a2f0f96e6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.342971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 167/325] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:42.343790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.375146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.376068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.376345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.376613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.377350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:42.377659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.379033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.391501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 159/326] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:42.391501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.435671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.448565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb12ae-d054-4c38-bb83-7aa33666a70a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.475266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.484151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.484976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.485266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.485548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.487971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619910-f926-4c54-b29a-ec9bb2bf7d08 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.495778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:42.504633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:42.505500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:42.506289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 168/327] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:42.507284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.525148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.525931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.526210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.526482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.527661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.529089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.530684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 160/328] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:42.531453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.607615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6b48-d760-4b91-91fa-c7927bd225ba None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.630119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75169-e508-4284-9678-17120c7f470d None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.640503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.641371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.641695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.642006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] PATH_INFO: `/v3/users/607130a8e5cb416093b2196f30196b6c` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.643308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] RBAC: Authorizing `identity:get_user(user_id=607130a8e5cb416093b2196f30196b6c)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.643606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.645403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.647319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 169/329] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/users/607130a8e5cb416093b2196f30196b6c => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:42.648065 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.669932 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.670604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.670930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.671230 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.671952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:42.672262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.673726 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.681731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 161/330] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:42.682531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.708852 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.752454 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819c366-07ea-438d-bbbb-135d636b79a0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.781396 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3876d-b593-43b6-bf2a-af0e35504d57 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.786678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.787372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.787660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.787942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] PATH_INFO: `/v3/groups` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.788631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.790100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.805450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 170/331] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jul 12 10:01:42 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:01:42.806270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:42.815916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.816928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.817399 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.817852 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.818746 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] RBAC: Adding query filter params (role.id=011626f50a8d4ca1b501b232111c2257, user.id=607130a8e5cb416093b2196f30196b6c, scope.system=all) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:42.819059 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.820566 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.833946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 162/332] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/role_assignments?user.id=607130a8e5cb416093b2196f30196b6c&scope.system=all&role.id=011626f50a8d4ca1b501b232111c2257 => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:42.924832 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a56bf-a7d5-44f6-a2a5-f29555516648 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:42.945651 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:42.972147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:42.973580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:42.973865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:42.974142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] PATH_INFO: `/v3/users/8c6c93c6aaec487caa5dd11619aa9886` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:42.975503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] RBAC: Authorizing `identity:get_user(user_id=8c6c93c6aaec487caa5dd11619aa9886)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:42.977016 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1aec8-5d50-4a56-aa1e-142a803a48b3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:42.983557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 171/333] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:42 2022] GET /identity/v3/users/8c6c93c6aaec487caa5dd11619aa9886 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:42.985307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:43.027156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:43.099824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a151-9856-4ced-b6e2-07b1352245a5 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:43.134007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:43.134910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:43.135205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:43.135486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] PATH_INFO: `/v3/system/users/8c6c93c6aaec487caa5dd11619aa9886/roles/1291f72e7fd8473faa3caa9120784c53` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:43.136987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8c6c93c6aaec487caa5dd11619aa9886, role_id=1291f72e7fd8473faa3caa9120784c53)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:43.138387 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ced47-2421-4e56-8fb5-ea9874cc629c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:43.146753 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 163/334] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jul 12 10:01:42 2022] PUT /identity/v3/system/users/8c6c93c6aaec487caa5dd11619aa9886/roles/1291f72e7fd8473faa3caa9120784c53 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:01:45.652330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c502ad-10f2-406b-b0f0-d050c007ad1c None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:45.652815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c502ad-10f2-406b-b0f0-d050c007ad1c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:45.652815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c502ad-10f2-406b-b0f0-d050c007ad1c None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:45.654163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 172/335] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:45.659706 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:45.660549 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:45.661040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:45.683895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:45.685422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:45.736421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2752-268a-402d-bf2f-20614965653f None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:45.737044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2752-268a-402d-bf2f-20614965653f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:45.737532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c2752-268a-402d-bf2f-20614965653f None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:45.739461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 173/336] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:45.747552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:45.748144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:45.748639 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:45.767788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 164/337] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:45.787907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:45.789525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:45.796068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:45.840466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:45.920781 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 174/338] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:45.956785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5550-5853-4cd8-bed5-dd3f36966bea None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:45.966370 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.020855 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.021671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.021955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.022230 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.043960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:46.056754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:46.057672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:46.058475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:46.061134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 165/339] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:46.067744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.189036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8296f-7015-4b2c-a591-77c1e5303e8e None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.202781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.205196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155da-bb58-4cd7-8891-2de53cdd2db6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.214408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.256184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.257357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.258166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.258446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.259302 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:46.259618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:46.260993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f99ea-1897-4450-ae60-b745ef32b0e8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:46.266242 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.267071 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.267364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.267634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.277868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 166/340] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:46.279500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f7a5-46b0-43e8-906d-17ff8b287171 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.279788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f7a5-46b0-43e8-906d-17ff8b287171 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.280068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f7a5-46b0-43e8-906d-17ff8b287171 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.281297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 167/341] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:46.282507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7111-1b82-4c8c-952b-d695c91784a6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.282825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7111-1b82-4c8c-952b-d695c91784a6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.283105 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe7111-1b82-4c8c-952b-d695c91784a6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.285444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 168/342] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:46.286826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe7111-1b82-4c8c-952b-d695c91784a6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.288532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b07cf2f5-98ba-4752-8eeb-395467c1a9a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:46.298471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:46.299430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:46.300218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:46.303045 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 175/343] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:46.304035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecc0-ac21-4325-927c-becc27f57c34 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.304372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecc0-ac21-4325-927c-becc27f57c34 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.304614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecc0-ac21-4325-927c-becc27f57c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.327955 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b0d1ecc0-ac21-4325-927c-becc27f57c34 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:46.329429 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b0d1ecc0-ac21-4325-927c-becc27f57c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:46.430533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 176/344] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:46.431951 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.432311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.432493 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe7111-1b82-4c8c-952b-d695c91784a6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.432726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.458050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:46.459189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:46.491817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.493225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.493740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.494256 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.525053 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.541920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 177/345] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:46.543091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.583442 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.601649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:46.604219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:46.668190 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4fa6-2868-417b-b906-5bdfac88755b None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.712377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.712861 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.713147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.713424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.714176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:46.714546 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:46.716602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:46.726436 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 178/346] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:46.727331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.741525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 169/347] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:46.747729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.817030 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.846443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:46.856930 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295da175-dffb-4df9-bd01-bb5e649afae8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.883730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3865fdf-89e5-4e60-bbb1-b8ae71a4446a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:46.902624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.903882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.903882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.904135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.916776 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:46.926909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:46.927834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:46.928676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 179/348] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:46.929310 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:46.943892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:46.947554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:46.947845 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:46.948121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:46.961527 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:46.972057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:46.973541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:46.974314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:46.977091 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 170/349] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:46.978167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.061296 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb779d-8978-408b-b10c-5b7bd0a9a026 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.100926 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.101633 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.101939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.102468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.110771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbf2d-d8a6-46ae-90cc-fe642a62f4f4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.123019 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.136510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.163870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.164791 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.165078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.165365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.169839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.169839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.174824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 171/350] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.174824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.193018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.194629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.304184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea45b10-9958-49a2-b6b7-d044ac1cb727 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.321676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 180/351] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:47.322528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.356935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.357850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.358136 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.358417 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.359221 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:47.359534 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.361202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a425525-12e6-4d8b-9a3b-e92697a264b3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.373008 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 172/352] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.374406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b067e34-3ce0-40da-b72c-b3a8b4a81048 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.374779 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b067e34-3ce0-40da-b72c-b3a8b4a81048 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.375026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b067e34-3ce0-40da-b72c-b3a8b4a81048 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.376640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 173/353] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:47.377914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b067e34-3ce0-40da-b72c-b3a8b4a81048 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.408810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.442580 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.470611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc0fe-dcc3-4a8c-950d-20876968b689 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.515487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.516155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.516444 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.516708 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.517458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:47.517761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.519722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.526024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b067e34-3ce0-40da-b72c-b3a8b4a81048 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.529634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 181/354] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.530545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.565572 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.566444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.566902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.567255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.576550 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.578010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.579900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 174/355] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.580607 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.656492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409d983-005d-433e-b0a5-a52c55b57b97 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.674538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.703786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.704665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.704950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.705231 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.706453 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.708492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153d589-75c2-4781-8d16-8d7c3a89534e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.710186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 182/356] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.714980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.714980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.714980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.727591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8d3b-c13b-4952-9e36-e9b0451a6cfe None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.730670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:47.731153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.731515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:47.770932 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.771995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.772376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.772758 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] PATH_INFO: `/v3/users/8c6c93c6aaec487caa5dd11619aa9886` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.774016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] RBAC: Authorizing `identity:get_user(user_id=8c6c93c6aaec487caa5dd11619aa9886)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:47.775788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:47.777612 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 175/357] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/users/8c6c93c6aaec487caa5dd11619aa9886 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:47.778198 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.811459 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 183/358] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:47.818786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:47.903702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d21611-102d-4d69-945b-6034e129cdee None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.943816 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.944476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.944766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:47.945047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:47.952293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382663b-7134-4670-b69e-477ff4de6b21 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:47.969283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.995383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:47.998752 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:47.999449 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:47.999735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.000003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.001111 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:48.001431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.002917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.011697 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 184/359] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.021906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.036095 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.037115 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.164939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a1e9-9ad7-42d3-88f6-d989b09638ed None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.172068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 176/360] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:48.172767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.213135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.214004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.214288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.214565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.216742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.218218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2c9ae-af52-466a-81a3-1a055947260f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.220095 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 185/361] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.221200 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f34f-c16d-4469-969a-db045f4ef2d3 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.221489 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f34f-c16d-4469-969a-db045f4ef2d3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.221767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947f34f-c16d-4469-969a-db045f4ef2d3 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.224021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 186/362] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:48.224744 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f34f-c16d-4469-969a-db045f4ef2d3 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.266180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.293128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.311619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02effad-6173-42e3-9edf-c4258a8eba9b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.361837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.362506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.362900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.363184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.364018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] RBAC: Adding query filter params (role.id=1291f72e7fd8473faa3caa9120784c53, user.id=8c6c93c6aaec487caa5dd11619aa9886, scope.system=all) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:48.364328 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.365793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.371401 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947f34f-c16d-4469-969a-db045f4ef2d3 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.387165 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 177/363] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/role_assignments?user.id=8c6c93c6aaec487caa5dd11619aa9886&scope.system=all&role.id=1291f72e7fd8473faa3caa9120784c53 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.391203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.425906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.427185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.427713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.428195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.442170 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:48.451302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:48.452297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:48.453088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:48.455988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 187/364] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:48.462742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.524846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bd157-99ea-4ac7-a3e7-ecfa08afe37c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.564115 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.572292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.573181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.573467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.573747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.575444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.577246 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c68ba-ad1d-45a8-85c0-42dfcebf80ae None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.584210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 178/365] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.585543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bf36f-1a1c-48a1-afe9-34da0517a793 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.585661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.585872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.586157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.594207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.608208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:48.609426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:48.630484 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.631192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.631485 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.631767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.632620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:48.632941 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.634393 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.641962 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 188/366] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=011626f50a8d4ca1b501b232111c2257 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.642599 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.726178 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 179/367] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:48.727742 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.789306 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545cf1-679a-4758-a593-1bcc0c5a95bc None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.843379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.844019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.844355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.844809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.845761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:48.845961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.847994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.858643 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 189/368] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.859584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:48.873623 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18cb24-4c6f-420d-910b-43004ff9fd13 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:48.901826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.910824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:48.920256 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:48.921379 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:48.921573 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:48.921905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:48.923162 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:48.924707 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:48.930841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 180/369] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:48.930841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.004011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6f59-59a8-4e32-acb5-754b85729d22 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.047514 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d3f3-7555-4352-a66b-e96fb5830109 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.049936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.051846 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.052285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.052707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.067620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:49.078557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:49.079673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:49.080614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:49.084343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 190/370] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:49.085332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.089602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.090669 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.090669 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.090934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.166619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:49.176625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:49.178319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:49.206125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:49.217535 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a255d9-b99e-4bff-92d1-173f32cea402 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.258791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.259890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.260475 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.260954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.261995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:49.262491 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:49.264839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:49.273605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 191/371] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=011626f50a8d4ca1b501b232111c2257 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:49.274773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.333141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 181/372] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:49.338751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.476183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7627d7-1329-499d-86ae-028f1b84b80a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.525672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.526278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.526568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.528306 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.532595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:49.532924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:49.534368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:49.548451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:49.554143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 192/373] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:49.556992 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ae53e-8697-4bd9-b15a-aaeb57c718b0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.559960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.584525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:49.629459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.630697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.631228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.631731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.635417 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:49.637090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:49.639346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 182/374] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:49.645007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.718512 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4d68-8a0c-40bf-9e52-c138da1e83f0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.762930 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.763590 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.763876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.764160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:49.838386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:49.839991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:49.869040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:49.877147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea4366-9016-41be-9f65-0786d95628ef None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:49.955829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 193/375] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 10:01:49.963539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:49.996046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:49.996928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:49.997218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:49.997500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.000822 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:50.002317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:50.004850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 183/376] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:50.010788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:50.079351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ffc8-94d2-482e-a6f1-9f21cc1298c9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:50.103867 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:50.118950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:50.129481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:50.130471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.130775 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.131057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] PATH_INFO: `/v3/projects/ee04a4e0146d43939fce14ce28c51a00` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.133551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] RBAC: Authorizing `identity:get_project(project_id=ee04a4e0146d43939fce14ce28c51a00)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:50.135172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:50.137218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 194/377] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:49 2022] GET /identity/v3/projects/ee04a4e0146d43939fce14ce28c51a00 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:50.142430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:50.253827 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d148d6-7c0b-4c7f-ac93-7f6ff0c73cab None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:50.281649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c1d4-6734-42e1-8a08-c4fb6f819ee2 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:50.292617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:50.293483 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.293888 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.294171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] PATH_INFO: `/v3/groups/2dac4e4be2814170a3dfd4f25f855177` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.306671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] RBAC: Authorizing `identity:get_group(group_id=2dac4e4be2814170a3dfd4f25f855177)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:50.308189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:50.310427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 195/378] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:50 2022] GET /identity/v3/groups/2dac4e4be2814170a3dfd4f25f855177 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:50.317289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:50.353405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:50.354128 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.354354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.354632 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.355488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:50.355807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:50.357246 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a35946-b4c9-492a-9015-b41694e35965 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:50.375135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 184/379] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:50 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 260 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:50.402533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:50.459041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981b29-d94c-466e-b6db-23ad174d5a33 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:50.495275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:50.495958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.496243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.496525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.497384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] RBAC: Adding query filter params (group.id=2dac4e4be2814170a3dfd4f25f855177, role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=ee04a4e0146d43939fce14ce28c51a00) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:50.497701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:50.499269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccaa13-3de0-4632-a5b2-2b74f223c5bd None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:50.506867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 196/380] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:50 2022] GET /identity/v3/role_assignments?group.id=2dac4e4be2814170a3dfd4f25f855177&scope.project.id=ee04a4e0146d43939fce14ce28c51a00&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:50.797751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af7d8-dbb1-48ba-8b5f-a0a8061f7ceb None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.798088 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af7d8-dbb1-48ba-8b5f-a0a8061f7ceb None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.798266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af7d8-dbb1-48ba-8b5f-a0a8061f7ceb None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.799937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 185/381] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:50.805643 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:50.805940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:50.806224 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:50.827722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:50.828939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:50.920935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 197/382] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:50.956982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af7d8-dbb1-48ba-8b5f-a0a8061f7ceb None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.086519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:51.096285 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af7d8-dbb1-48ba-8b5f-a0a8061f7ceb None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:51.140104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:51.140922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.141252 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.141606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.154187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:51.163082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:51.163961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:51.164740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 186/383] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:51.171713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.257448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:51.331681 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2ed0c-0176-4b3b-b248-a5481517f174 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:51.382178 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:51.382798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.383085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.383366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.384126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:51.384436 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:51.385946 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:51.400644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 198/384] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:51.407171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.539930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54857845-5e4f-4fda-b1c4-626f110fb43a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:51.586199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:51.587079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.587360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.587635 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.591365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:51.592804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2477e-b07e-4ee8-8b5d-6f67bafdf529 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:51.594813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 187/385] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:51 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:51.600453 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.704690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda2cc-036a-4774-a732-8c00b67b05a9 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.704979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda2cc-036a-4774-a732-8c00b67b05a9 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.705156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda2cc-036a-4774-a732-8c00b67b05a9 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.707524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 188/386] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:51.713720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.714159 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.714564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.734177 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:51.736251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:51.758130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:51.766915 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6c04-9a0c-489c-a17c-7f8f8cebf105 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:51.777367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:51.823720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 189/387] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:51.851379 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.856005 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:51.856890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:51.857176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:51.857457 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:51.863966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:51.865465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:51.867538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 199/388] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:51 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:51.872636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:51.975152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b887fc-4939-4b3b-a612-683946a328c3 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.018353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.020230 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.020656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.021313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.034279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-526bf562-674e-43c8-a2a9-30b7e1af4a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:52.043229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:52.044202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:52.044979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 190/389] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:52.050470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31e7e-77c4-49c0-b526-9af3122ab1cd None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.050470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31e7e-77c4-49c0-b526-9af3122ab1cd None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.050470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31e7e-77c4-49c0-b526-9af3122ab1cd None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.050470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 191/390] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:52.055075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31e7e-77c4-49c0-b526-9af3122ab1cd None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.067188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7da3f-9c2c-4e75-b4fb-e343359e1785 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.099052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.104396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.105404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.105692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.105972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/91d3ea3054c242e893f97d92dc2dabb6` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.108324 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, group_id=b484f3a604974c1cbee9d54c9e6c3565, role_id=91d3ea3054c242e893f97d92dc2dabb6)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.109918 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425290c8-cbac-4798-bfbf-c3e8069519e0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.125491 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 200/391] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 12 10:01:51 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/91d3ea3054c242e893f97d92dc2dabb6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:01:52.127225 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.127523 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.127854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.166213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:52.167474 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:52.190278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31e7e-77c4-49c0-b526-9af3122ab1cd None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.235940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.236570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.236861 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.237147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.238070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:52.238391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.240263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.252080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 192/392] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:52.259610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.260969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.342619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 201/393] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:52.374683 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.403078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.428199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071761c5-7c48-4b58-be23-f162291bda45 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.487568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.488390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.488673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.488950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.495068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.496524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.500841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 193/394] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:52.505585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.549840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372b29-5645-4e4e-bbfa-49fdd74ad2c1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.587121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.587920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.588207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.588482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.600148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:52.608264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:52.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:52.609887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 202/395] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:52.616068 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.645110 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.724816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc2339-8e30-4049-b98e-72dc558ec900 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.760617 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.761204 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.761425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e301adc-c5a9-4e19-8df5-e053d17f76a0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.761527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.761751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.762502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:52.762844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.766723 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.778447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 203/396] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:52.779767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.841556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.842429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.842728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.843019 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.844223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.855193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.857365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 194/397] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:52.862626 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:52.881899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.889394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd32d83-6ce4-4d38-9015-4646a18d0676 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:52.889991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:52.927154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:52.928339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:52.928796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:52.929218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:52.930696 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:52.932444 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:52.938870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 204/398] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:52.940898 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.054255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101902e-fb80-4baf-b88e-8751d7202bba None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.096247 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3b157-72d9-407e-894c-e39d6b3c909e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.106891 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.108374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.108877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.109354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.110820 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:53.112462 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517da391-3f51-4844-9f78-ad31927c1e72 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:53.115317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 205/399] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:52 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:53.116829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0eb0-70cb-41a8-a9a4-c818361eb1f8 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.117330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0eb0-70cb-41a8-a9a4-c818361eb1f8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.117798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a0eb0-70cb-41a8-a9a4-c818361eb1f8 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.123358 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 206/400] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:53.126098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.126608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.127116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.143464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.144679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.145058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:53.145333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.145752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.146530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:53.148141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ba9ff2c7244be68341aca9cfac14b3, group_id=b484f3a604974c1cbee9d54c9e6c3565, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:53.151032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:53.165777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:53.169578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 195/401] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 12 10:01:52 2022] PUT /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:01:53.170608 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.261406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:53.296402 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 207/402] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:53.297195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd83c0f-1064-4a7f-ad16-c4179a83da2a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.335800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.336652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.337741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.338412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.339082 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.342368 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, group_id=b484f3a604974c1cbee9d54c9e6c3565, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:53.344071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:53.369918 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 196/403] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 12 10:01:53 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:53.501323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e42ae5-4de2-4c30-b8de-67e9940b4241 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.540724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.541527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.541808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.542081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.554318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-651eeab3-3769-48c9-8c10-83f870bb4e90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:53.562299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:53.563357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:53.564341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 208/404] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:53.569759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.572283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00f88-66ec-475b-8f9f-d3fcf163cef2 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.572574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00f88-66ec-475b-8f9f-d3fcf163cef2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.572993 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00f88-66ec-475b-8f9f-d3fcf163cef2 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.574832 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 209/405] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:53.580468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.580778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.581030 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.603335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:53.604724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:53.616522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:53.687214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 210/406] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:01:53.698455 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb55a-d391-4099-8dd9-5dc78694fda9 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.712430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.741201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:53.755884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.756574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.756860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.757140 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.759108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:53.759445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:53.760974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:53.774210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 197/407] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:53.779765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.894802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bfc10-89c0-4eda-9119-07991a3fae96 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.953483 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:53.954370 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:53.954652 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:53.954970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:53.966261 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:53.974317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:53.975431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:53.976373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:53.978566 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 211/408] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:53.986333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ed21-c1be-43b5-88f1-91d52337da1c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:53.987876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:53.999133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.063370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.064317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.064599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.064876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] PATH_INFO: `/v3/groups/2dac4e4be2814170a3dfd4f25f855177` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.067249 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] RBAC: Authorizing `identity:get_group(group_id=2dac4e4be2814170a3dfd4f25f855177)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.068697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.070503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 198/409] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:53 2022] GET /identity/v3/groups/2dac4e4be2814170a3dfd4f25f855177 => generated 229 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:54.075614 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:54.168463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.191769 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79b7f-2e2d-45f2-bd8d-1f6c7d2382c5 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.203914 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff62635-8549-41d9-ada8-e5f42c8c6a06 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.226934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.228046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.228477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.228896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] PATH_INFO: `/v3/projects/ee04a4e0146d43939fce14ce28c51a00` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.230227 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] RBAC: Authorizing `identity:get_project(project_id=ee04a4e0146d43939fce14ce28c51a00)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.231849 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.234047 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 199/410] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:54 2022] GET /identity/v3/projects/ee04a4e0146d43939fce14ce28c51a00 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:54.243625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:54.268207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.269416 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.269710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.269993 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.270990 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:54.271313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.272843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.289891 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 212/411] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:54.295577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:54.355923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc685e1-5751-491d-8cc2-57549a090732 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.387103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.396684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.397823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.398296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.398769 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] PATH_INFO: `/v3/projects/ee04a4e0146d43939fce14ce28c51a00/groups/2dac4e4be2814170a3dfd4f25f855177/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.401236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee04a4e0146d43939fce14ce28c51a00, group_id=2dac4e4be2814170a3dfd4f25f855177, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.403040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.406537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.420275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 200/412] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 12 10:01:54 2022] PUT /identity/v3/projects/ee04a4e0146d43939fce14ce28c51a00/groups/2dac4e4be2814170a3dfd4f25f855177/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:54.478965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d1f3-3865-4010-be10-0e5d742dc018 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.527101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.528331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.528821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.529282 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.530808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.532545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.534474 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 213/413] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:54 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:54.539910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:54.685325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9108d35-a980-45dd-8415-ff1da6fa6c34 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.719838 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.720699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.720989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.721268 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.723073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.724579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb81a23-55c5-45d6-9917-52f27cf7a795 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.726302 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 201/414] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:54 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:54.731939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:54.806882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fddca-4118-4b80-9ad6-d6080e4f7f4e None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.807191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fddca-4118-4b80-9ad6-d6080e4f7f4e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.807450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fddca-4118-4b80-9ad6-d6080e4f7f4e None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.809076 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 202/415] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:54.814497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.814814 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.815098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.838733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:54.838733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:54.892819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344503-4049-40c4-bc18-9708f6b8af93 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:54.923778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.933831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:54.934726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:54.935011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:54.935286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/91d3ea3054c242e893f97d92dc2dabb6` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:54.942601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0692c82e6c1a44d9a2a3f4deec337429, group_id=b484f3a604974c1cbee9d54c9e6c3565, role_id=91d3ea3054c242e893f97d92dc2dabb6)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:54.943070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:54.944053 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:54.966089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 203/416] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:54.973267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 214/417] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 12 10:01:54 2022] PUT /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429/groups/b484f3a604974c1cbee9d54c9e6c3565/roles/91d3ea3054c242e893f97d92dc2dabb6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:01:55.003461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:55.121643 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389276d-5122-417a-8d41-44333e6c6e15 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:55.162563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:55.163433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:55.163719 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:55.163990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:55.176297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:55.185553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:55.186561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:55.187817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 204/418] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:55.193816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:55.300461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3476-9128-43be-8ef8-9698af1852a2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:55.336649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:55.337311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:55.337640 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:55.337919 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:55.338669 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:55.339031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:55.340463 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:55.349901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 215/419] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:55.355420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:55.420281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:55.482537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28221ac-a788-4065-80ba-633f1af18925 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:55.529452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:55.530157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:55.530440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:55.530780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:55.622186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:55.623751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:55.678551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:55.737092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 205/420] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:55.742924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:55.821973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:55.884467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198a96-8c43-44fc-bee0-49e9040b2883 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:55.928943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:55.930155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:55.930661 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:55.931230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:55.932623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:55.934266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:55.936518 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 216/421] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:55 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:55.942879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.094801 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1985-d041-4eb9-bbf0-f72c8880a3ad None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.136597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.137454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.137744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.138019 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.139784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:56.141298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b114747-07d3-4215-abf5-e167f35b950a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:56.143254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 206/422] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:55 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:56.149746 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.219090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e1ec3-6344-45a8-8882-8f2a3ffe3886 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.220024 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e1ec3-6344-45a8-8882-8f2a3ffe3886 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.220521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e1ec3-6344-45a8-8882-8f2a3ffe3886 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.222926 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 207/423] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:01:56.227761 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4bb31-f521-48f2-acae-69cad7155a16 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.228290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4bb31-f521-48f2-acae-69cad7155a16 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.228762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4bb31-f521-48f2-acae-69cad7155a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.247723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-ace4bb31-f521-48f2-acae-69cad7155a16 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:56.249744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-ace4bb31-f521-48f2-acae-69cad7155a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:56.271112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:56.332396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309602-701c-4d5d-8ad8-c6579ece702b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.356524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:56.360035 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 208/424] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:56.362776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d87ea-e3c6-4151-85f0-a395cad74504 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.363482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d87ea-e3c6-4151-85f0-a395cad74504 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.364025 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d87ea-e3c6-4151-85f0-a395cad74504 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.366646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 209/425] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:56.370259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.371276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.371773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.371967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.372272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.372555 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.372842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.373860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:56.374424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:56.376411 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:56.383654 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 217/426] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:56.405215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:56.405788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.409078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:56.544461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 210/427] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:56.581713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1e298-27bd-4efb-9bf0-23df6ae8c538 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.611727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.626403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.627249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.628140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.628948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.642877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:56.653540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:56.654414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:56.655230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:56.655826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 218/428] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:56.662016 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.727796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:56.734353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:56.760074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f857-6586-4360-b531-537b2ea37514 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.799356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.801336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.801584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.801964 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.804692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5efbdb-4d56-427e-9d36-21417117f43a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.815495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:56.826564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:56.827521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 10:01:56.828296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:56.828869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 211/429] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:56.835057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.854861 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.856792 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.857191 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.857362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:56.858107 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] RBAC: Adding query filter params (name=member) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:56.858411 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:56.859959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:56.869877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 219/430] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:56.875323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:56.957344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3953b-e932-459a-ae1c-aad1876b1257 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.980008 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e26d-aec4-49e8-a9b9-e001876e634e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:56.989511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:56.997217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:56.998424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:56.998948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:56.999672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.001295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:57.001824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.004491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.016411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 212/431] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:57.021129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.021289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.021368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.021368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.021368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.022601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.119200 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.121799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.159289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ed59f-c456-49dd-8959-aed88863fff8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.205906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.207483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.208005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.208938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.239017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 220/432] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:57.241781 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.254003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.284585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.288698 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.290163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d523913-e920-4ec0-a78a-edad86fa79f3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.351666 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6008fa-9ddd-44de-b28e-47142e9a63e9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.389963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.390770 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.391084 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.391405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] PATH_INFO: `/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.392606 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ba9ff2c7244be68341aca9cfac14b3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.394718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a7615-1eae-4c44-ba6c-3cacc0303b55 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.398751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 221/433] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/projects/a5ba9ff2c7244be68341aca9cfac14b3 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:57.398751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335267da-6796-4955-902f-d3484830c322 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.398751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335267da-6796-4955-902f-d3484830c322 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.398751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335267da-6796-4955-902f-d3484830c322 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.399561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 222/434] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:57.404327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335267da-6796-4955-902f-d3484830c322 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.411538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 213/435] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:57.411538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.411538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.411538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.427276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:57.428465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:57.495614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.502765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 214/436] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:57.502765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.534840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335267da-6796-4955-902f-d3484830c322 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.545268 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.571575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.572423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.572701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.572971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.574131 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.575626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.577381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 223/437] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:57.577961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.632928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3339f4-659b-4649-8b07-7709f4d1eab1 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.668880 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.669657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.669944 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.670228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.671406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.672929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.674627 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 215/438] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:57.679353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.689478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507dbe7-dbef-43c1-ad76-924a3aab9b18 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.726539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.727410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.727748 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.728013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.740377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:57.748514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:57.749500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:01:57.750266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 224/439] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:01:57.751692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.757207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.786233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:57.793112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b578b70-a49d-403b-9bd9-382cd9cd3f42 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.829622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.830278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.830567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.830879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.831824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:57.832205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.833723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.851083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 216/440] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=a5ba9ff2c7244be68341aca9cfac14b3&role.id=011626f50a8d4ca1b501b232111c2257 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:57.851922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.868007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac8b0d-773f-46c1-aec5-09ec6e5084e0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:57.915044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:57.915920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.916206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.916488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.917761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:57.919479 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8289a5-25d7-4954-9e45-d49eebcf1952 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:57.926322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 225/441] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:57.926322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5fa3-e339-444e-9b82-42ea76e5a398 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:57.926322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5fa3-e339-444e-9b82-42ea76e5a398 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:57.926322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5fa3-e339-444e-9b82-42ea76e5a398 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:57.926322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 226/442] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:01:57.928093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5fa3-e339-444e-9b82-42ea76e5a398 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:57.980222 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab3b6-f8e1-4549-ba83-22f66726fd93 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.010143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.021321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.022000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.022294 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.022582 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.023631 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:58.023737 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.025101 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fc730-50ba-4d61-892a-90ccd81055b9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.035179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 217/443] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:58.036752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.036752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.036957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.052605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5fa3-e339-444e-9b82-42ea76e5a398 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.055698 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:01:58.057080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:01:58.077863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.099544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.100205 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.100489 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.100769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.101609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=011626f50a8d4ca1b501b232111c2257, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:58.101925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.103519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.112344 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 227/444] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:57 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=011626f50a8d4ca1b501b232111c2257 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:58.113052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.147653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 218/445] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:01:58.173952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.251504 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c577c-929a-4775-8874-f668c2f9e42b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.300964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.301627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.302346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.302346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.312425 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.325426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d867c-7f41-418c-b622-ab1678abf5e9 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.367410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.368593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.368879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.369156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.383312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:01:58.391447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.393571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:01:58.395061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:01:58.395923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:01:58.396711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 219/446] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:01:58.401991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.418672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.517728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 228/447] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:01:58.523203 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.526083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88123d-2c57-463d-b112-e2e3e4229e44 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.564585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.565903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.566645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.569297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.569297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.569297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:58.569297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.569679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.580266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 220/448] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:58.585890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.643096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ebd6-fbc0-4690-9083-71b3dc0732a0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.666762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.679706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.680565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.680851 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.681130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] PATH_INFO: `/v3/projects/ee04a4e0146d43939fce14ce28c51a00` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.682317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] RBAC: Authorizing `identity:get_project(project_id=ee04a4e0146d43939fce14ce28c51a00)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.683810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.685488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 229/449] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/projects/ee04a4e0146d43939fce14ce28c51a00 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:58.691594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.693174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73236f9-f479-4892-b970-b9c976513219 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.726406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.727080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.727370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.727655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.789642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed651ab6-2663-40f6-9415-9217b813d28a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.791855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.795238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.796708 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.824364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.825209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.825492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.825764 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] PATH_INFO: `/v3/groups/2dac4e4be2814170a3dfd4f25f855177` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.827011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] RBAC: Authorizing `identity:get_group(group_id=2dac4e4be2814170a3dfd4f25f855177)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.828460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.834919 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 230/450] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/groups/2dac4e4be2814170a3dfd4f25f855177 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:58.835903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.875864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:58.902444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 221/451] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 10:01:58.907980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:58.935810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58564969-27d7-4096-b294-fc8637fd60b1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:58.969969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:58.970620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:58.970931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:58.971209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:58.972657 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] RBAC: Adding query filter params (group.id=2dac4e4be2814170a3dfd4f25f855177, role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=ee04a4e0146d43939fce14ce28c51a00) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:58.972976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:58.974417 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:58.980319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 231/452] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/role_assignments?group.id=2dac4e4be2814170a3dfd4f25f855177&scope.project.id=ee04a4e0146d43939fce14ce28c51a00&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:59.005819 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a78a-3425-41e4-ae4b-27bf58cfddd3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:59.043825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:59.044636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:59.044925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:59.045204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] PATH_INFO: `/v3/projects/0692c82e6c1a44d9a2a3f4deec337429` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:59.046422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0692c82e6c1a44d9a2a3f4deec337429)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:59.047995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:59.049696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 222/453] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 12 10:01:58 2022] GET /identity/v3/projects/0692c82e6c1a44d9a2a3f4deec337429 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:01:59.055620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:59.093281 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:59.162167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf074-3800-4a2e-8c94-47c100745bb1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:59.198502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:59.199385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:59.199670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:59.199946 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] PATH_INFO: `/v3/groups/b484f3a604974c1cbee9d54c9e6c3565` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:59.201117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] RBAC: Authorizing `identity:get_group(group_id=b484f3a604974c1cbee9d54c9e6c3565)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:59.202591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65a397-f839-4dd7-a8fa-6805ad181c54 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:59.204234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 232/454] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 12 10:01:59 2022] GET /identity/v3/groups/b484f3a604974c1cbee9d54c9e6c3565 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:01:59.210830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:01:59.251823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:01:59.304861 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e786-2ca2-479b-ac2c-dd843e1a45b3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:01:59.336607 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:01:59.337238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:01:59.337519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:01:59.337795 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:01:59.338605 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] RBAC: Adding query filter params (group.id=b484f3a604974c1cbee9d54c9e6c3565, role.id=91d3ea3054c242e893f97d92dc2dabb6, scope.project.id=0692c82e6c1a44d9a2a3f4deec337429) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:01:59.338947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:01:59.340361 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02e11-f887-4f56-84a9-6e082421212c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:01:59.345881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 223/455] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 12 10:01:59 2022] GET /identity/v3/role_assignments?group.id=b484f3a604974c1cbee9d54c9e6c3565&scope.project.id=0692c82e6c1a44d9a2a3f4deec337429&role.id=91d3ea3054c242e893f97d92dc2dabb6 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:02.005458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd40f-f23b-42ba-b819-68edc11bc0d1 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.005982 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd40f-f23b-42ba-b819-68edc11bc0d1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.005982 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd40f-f23b-42ba-b819-68edc11bc0d1 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.007799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 233/456] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:02.013556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d5b8-ceca-4521-b158-8a06e73325de None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.014530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d5b8-ceca-4521-b158-8a06e73325de None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.015044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d5b8-ceca-4521-b158-8a06e73325de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.032432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4a70d5b8-ceca-4521-b158-8a06e73325de None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:02.033933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4a70d5b8-ceca-4521-b158-8a06e73325de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:02.107209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 224/457] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:02.134254 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afd40f-f23b-42ba-b819-68edc11bc0d1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.178097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20971-c340-49f4-a286-24304f7995ad None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.178388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20971-c340-49f4-a286-24304f7995ad None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.178960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20971-c340-49f4-a286-24304f7995ad None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.180826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 225/458] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:02.186139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074187-2de0-40a5-9376-91f1270a19da None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.186676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074187-2de0-40a5-9376-91f1270a19da None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.187199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df074187-2de0-40a5-9376-91f1270a19da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.204080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-df074187-2de0-40a5-9376-91f1270a19da None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:02.205584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-df074187-2de0-40a5-9376-91f1270a19da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:02.243079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.255021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afd40f-f23b-42ba-b819-68edc11bc0d1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.271148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.290321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 226/459] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:02.296658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.297571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447d4a-064e-405a-9b46-dd0b1daa653e None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.297722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.297922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.298202 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.298582 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447d4a-064e-405a-9b46-dd0b1daa653e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.299027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447d4a-064e-405a-9b46-dd0b1daa653e None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.305181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 227/460] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:02.306510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.306973 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.307398 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.310135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.311786 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.325005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:02.326370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:02.330899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:02.331870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:02.333080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:02.333080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:02.333080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.333080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:02.333080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 234/461] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:02.333362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.403062 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 228/462] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:02.403998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.457709 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f6d2-cd5b-489e-81c0-2c18e2f7b340 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.499053 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.499912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.500202 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.501044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.508176 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.512980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.514471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.514572 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f562e-e5fd-497c-a471-15b0d6e73e11 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:02.533375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:02.534290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:02.535730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:02.535730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:02.535730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.535730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:02.535730 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 235/463] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:02.535982 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.548241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.557281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.557958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.558244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.558524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.559289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:02.559603 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.560991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.577374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 229/464] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:02.577374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.648313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae210-9e13-46a8-a4db-e2af1e7e0664 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.680910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d71fc0-3083-4133-b84f-fecf9b157ac0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.681258 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.682047 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.682338 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.682614 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.693306 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.694828 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:02.712073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:02.713056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:02.714000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:02.714000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:02.714000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:02.714000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:02.714000 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 236/465] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:02.714266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.716931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.717587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.718052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.718174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.718874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:02.719185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.720546 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f8e08-c44e-4aec-8c45-8eef7c8e60d8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.733152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 230/466] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:02.734473 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45990-01c0-41b4-af76-10cd6f2bcb38 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.734814 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45990-01c0-41b4-af76-10cd6f2bcb38 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.735104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45990-01c0-41b4-af76-10cd6f2bcb38 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.736703 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 231/467] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:02.737241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45990-01c0-41b4-af76-10cd6f2bcb38 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.755789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.775985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:02.815929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72812c76-5108-47d6-883e-25f7c802847b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.837830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45990-01c0-41b4-af76-10cd6f2bcb38 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:02.850536 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.851229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.851516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.851800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.852508 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.853967 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634bc5-0e10-47fd-843f-77702ceee7ed None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.871963 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:02.872645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.873155 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.873261 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 237/468] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/users => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:02.873359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.874032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:02.874225 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:02.874335 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:02.874497 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:02.874790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:02.876023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:02.893284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:02.895185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:02.905317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 232/469] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:02.905317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:02.979720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 238/470] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:02.980703 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:03.006110 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:03.032031 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8eea2-5f6f-4831-8fa3-8b639af8d1db None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:03.046948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:03.071448 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:03.072548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:03.072548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:03.072748 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:03.073506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:03.074732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:03.098635 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 233/471] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:03.099688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:03.120813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d22b5-1b06-45a3-82f0-aa1316fe2ff2 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:03.173518 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:03.175415 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:03.175909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:03.176871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:03.178064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:03.180477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:03.208975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 239/472] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:02:02 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:03.240628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70279-0911-4bd0-95d2-f13f1d32857b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:03.279996 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:03.286957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:03.287869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:03.288159 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:03.288508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:03.302430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:03.304058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:03.325574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:03.326439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:03.327451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:03.327451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:03.327451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:03.327451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:03.327451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 234/473] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:03.332927 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:03.457276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c83a-d7ca-477f-83c2-50c559e04a69 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:03.459036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:03.494553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:03.495296 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:03.495585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:03.495863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:03.496597 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:03.496905 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:03.498311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e791e-4a95-4c72-80b5-fd598a24b142 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:03.521950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 240/474] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:03.523334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:03.638126 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47a053-829e-48ac-be92-8cb11cc8fe5c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:03.673618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:03.674639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:03.675785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:03.676304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:03.677223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:03.678895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711913e-6667-4a84-a3f1-0e62909f5d04 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:03.702685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 235/475] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:02:03 2022] POST /identity/v3/users => generated 249 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:05.267444 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263ad6-b50a-40b1-9e0e-5002e9be6c03 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.267996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263ad6-b50a-40b1-9e0e-5002e9be6c03 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.267996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263ad6-b50a-40b1-9e0e-5002e9be6c03 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.269658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 241/476] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:05.274813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.275213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.275376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.292514 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:05.293706 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:05.328520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:05.365303 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 236/477] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:05.390192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17263ad6-b50a-40b1-9e0e-5002e9be6c03 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:05.505917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17263ad6-b50a-40b1-9e0e-5002e9be6c03 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:05.543174 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:05.544455 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.544991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.545511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.560952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-5236205d-b118-498d-b3bf-5f3956720937 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:05.570550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:05.571465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:05.572239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 242/478] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:05.577699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:05.593587 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd96c-b0a3-4f3c-a872-dfa586df438b None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.593884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd96c-b0a3-4f3c-a872-dfa586df438b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.594171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd96c-b0a3-4f3c-a872-dfa586df438b None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.595857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 243/479] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:05.601956 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042360d7-af22-4cf3-ae5b-919c55393f1c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.602250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042360d7-af22-4cf3-ae5b-919c55393f1c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.602533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042360d7-af22-4cf3-ae5b-919c55393f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.621988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-042360d7-af22-4cf3-ae5b-919c55393f1c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:05.623342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-042360d7-af22-4cf3-ae5b-919c55393f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:05.642048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:05.683717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876645b-4fce-4e59-ab42-4d0ef897c918 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:05.697210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 244/480] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:05.698564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecdc-360f-4e4e-aade-b4f1e1a7729d None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.698910 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecdc-360f-4e4e-aade-b4f1e1a7729d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.699208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ecdc-360f-4e4e-aade-b4f1e1a7729d None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.704457 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 245/481] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:05.708036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.708330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.708613 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.728491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:05.729164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.729288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:05.729448 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.729725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.730418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:05.730513 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:05.730802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:05.732177 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:05.744503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 237/482] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:05.744503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:05.777500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:05.804446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 246/483] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:05.805311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:05.865289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591aca-3693-42f3-8c2f-a1fedeb4eb7e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:05.900189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:05.905855 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:05.907022 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.907621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.907906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.920310 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a756-a9e2-4c12-98ac-072ff370a9f8 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:05.922558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:05.930664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:05.931583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:05.932351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 238/484] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:05.932985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:05.963716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:05.964607 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:05.965077 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:05.965259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:05.976270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:05.977740 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:05.996949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:05.997899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:05.998728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:05.998728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:05.998728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:05.998728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:05.998728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 247/485] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:05.999424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.037576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.050203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e5ee4-13ea-4d24-b96f-fdb197a605ed None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.083548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.084335 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.084616 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.084888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.094833 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:06.102360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:06.103351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:06.104170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 239/486] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:06.104813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.120737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47413c-b382-40bc-b0fb-deb02b1cdf45 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.153879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.154530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.154842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.155119 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.155859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.156165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.157552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c0e89-b84c-4554-b397-fd243a3db687 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.158894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 248/487] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bd5a5-adaf-4f6a-b6de-ba2f091e5b80 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bd5a5-adaf-4f6a-b6de-ba2f091e5b80 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bd5a5-adaf-4f6a-b6de-ba2f091e5b80 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 249/488] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:06.166693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bd5a5-adaf-4f6a-b6de-ba2f091e5b80 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.206448 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061f39-a7c6-4f52-9210-ed20ddc8ad3e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.239288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.239940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.240218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.240488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.241228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.241528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.242920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26f55c-cfdf-41be-b8b7-7972426ba25a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.255577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 240/489] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.256752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.257036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.257311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.272786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:06.273972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:06.275439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bd5a5-adaf-4f6a-b6de-ba2f091e5b80 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.281922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.313087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.313752 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.314040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.314322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.315115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.316132 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.317519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.325271 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 250/490] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.326043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.340923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 241/491] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:06.341679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.394336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.438837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e626b0-7667-4d53-9a1e-12ccb99894f0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.439023 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93cf87-f8c6-4133-a492-feaa211dc77f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.471954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.472147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.472772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.472941 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.473099 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.473202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.473363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.473452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.480386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.481832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.484155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.485714 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:06.497671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:06.498541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:06.499433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 242/492] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:06.499979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.502826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:06.504106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:06.504929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:06.505745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:06.505745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:06.505745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:06.505745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:06.506113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 251/493] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:06.507162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.602215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edf95-8612-4b4a-9450-64d64e79c304 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.606320 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037e651-c645-4fe8-bb57-f89cdb4828a1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.617078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.636251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.637052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.637339 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.637621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.640983 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.641772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.642059 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.642343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.647974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.649431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.652502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:06.660901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:06.661756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:06.662507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 252/494] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:06.663207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:06.666772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:06.667533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:06.668357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:06.668357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:06.668357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:06.668357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:06.668357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 243/495] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:06.668897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.722539 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.765982 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd247f05-f183-4724-ab2f-ae3dfa33e6e2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.766411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fb99-1f12-4df2-bb04-612e92c621c6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.799106 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.799467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.799826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.800632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.800731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.800917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.801013 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.801274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.801757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.801988 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.802075 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.802297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.803535 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.803707 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.815500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 244/496] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.816288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.838969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 253/497] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.839795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.868357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.924933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedf244-c4fe-4b2b-94d5-e2947ee87849 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.938895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:06.940482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea57ccc-f227-4790-849b-5ac599fd7fcc None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:06.959147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.959804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.960088 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.960381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.961173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.961489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.962910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.970888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 245/498] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.971587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:06.979675 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:06.980339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:06.980623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:06.981310 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:06.982046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:06.982357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:06.983813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:06.995565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 254/499] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:06.996379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.073607 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9789d-8eac-4549-87d5-0c200388c5f8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.086094 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.099412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd9dd-62bb-46ad-8ebd-c012e99ceb72 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.110232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.111045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.111326 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.111599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.118938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.120322 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.132704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.133345 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.133629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.133908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:07.134307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:07.135179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:07.136071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 246/500] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:07.136617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.171038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.203161 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.204652 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.234025 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92030-4fd5-4ab3-9948-c38a17d539c4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.268406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.269891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.270237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.270577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.281438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.283094 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.290896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:07.300510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:07.301426 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:07.302260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:07.302260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:07.302260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:07.302260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:07.302260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 247/501] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:07.302589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.308656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 255/502] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:07.308656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.389695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.402378 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6f57-e404-432b-bb46-1de41fa674c6 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.403661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252052-8606-4842-ab02-87f7baa7832a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.435105 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.435481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.435766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.436050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.436252 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.436352 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.436534 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.436809 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.437177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:07.437490 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.438966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.444696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.446126 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.456906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 256/503] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:07.457710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:07.460792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:07.461794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:07.462658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 248/504] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:07.463232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.505170 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.564668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e060a-eae5-43f8-a94d-e55ac7021df7 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.565250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8479c6-8546-4389-82cf-95d32b609bf2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.600121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.600899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.601181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.601453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.611781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.613735 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.616830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.617492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.617775 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.618053 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.618808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:07.619121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.620502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.621463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:07.632425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:07.633501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:07.634351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:07.634351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:07.634351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:07.634351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:07.634351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 249/505] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:07.634883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.637637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 257/506] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:07.639315 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.731668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4b3cc-4a69-449c-afd6-0b787fae5134 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.736590 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd14e2-46a9-4602-a0e0-4d3b7457bbc5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.744377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.767204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.767847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.768132 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.768429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.772226 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.772896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.773182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.773462 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.774302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:07.774616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.776099 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.793627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 258/507] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:07.794422 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.834281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:07.836599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.838531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.895336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdfff4-32f0-454d-b612-33ee3adf821d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:07.930228 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:07.931175 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:07.931461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:07.931745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:07.937703 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 250/508] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:07.938760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.939836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:07.941844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:07.957658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:07.958558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:07.960051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 259/509] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:07.963623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:07.989276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.036750 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.039548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a6c46-3e74-4412-8332-04aeda57b15b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.069158 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465469a5-c2a7-45fd-94cf-00896510a714 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.073210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.073862 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.074146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.074422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.075168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:08.075477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.076828 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.087995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 251/510] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:08.088977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.106815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.107465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.107745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.108024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.174305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.176429 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.186132 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4c013-fcd5-4062-b32c-ef45c081da13 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.199049 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.218762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.219679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.219959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.220237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.231667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.233105 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:08.250878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:08.251701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:08.252574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:08.252574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:08.252574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:08.252574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:08.252574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 252/511] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:08.252868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.267154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.275662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 260/512] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:08.276507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.351489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af7f32-c4e6-41d5-9826-d3a1c0e6d320 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.373341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904374-6c08-4ea6-990c-03cb4a524a26 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.384243 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.384987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.385339 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.385624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.386565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:08.386916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.389991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.400320 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.413239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.414028 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.414310 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.414587 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.421164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.422626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.429920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 253/513] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:08.430788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:08.436580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:08.437609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:08.438460 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 261/514] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:08.438956 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.500036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.530192 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dcba-00a4-4032-9560-5cfe1c5c27f4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.541738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51668c-4229-4121-9363-984347ce2951 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.563061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.563710 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.563993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.564273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.564989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:08.565303 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.566664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.574567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.575372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.575649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.575922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.577883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 254/515] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:08.578766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.591907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.593397 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:08.613392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:08.614322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:08.615188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:08.615188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:08.615188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:08.615188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:08.615188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 262/516] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:08.615441 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.653286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.682179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23584f8-be94-4269-8e7f-0a426de3abd5 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.710026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.716106 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.716744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.717026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.717167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c470-6f50-4262-aeea-344e8b19827d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.717289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.749941 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.750877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.751162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.751434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.752246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:08.752557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.754524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.772003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 263/517] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:08.772796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.788062 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.789459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.866724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.873030 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d5cc-8066-41c2-876e-26ea4106562c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:08.887120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 255/518] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:08.887955 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.912702 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:08.913495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:08.913778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:08.914057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:08.916710 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:08.920798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:08.922268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:08.936331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:08.937275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:08.938096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 264/519] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:08.938547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:08.989815 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b450c2-cfb7-4a05-8ecb-784b592640e0 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.023308 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.023961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.024247 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.024525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.025244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.025554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.026959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.037023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb62-7a2c-4625-890a-208e2b5659f8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.037821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 256/520] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.038655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.075194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.075840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.076120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.076396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.077221 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=b2080c582ab448d587b35d6a100cad12) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.077543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.079007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.085087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 265/521] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:08 2022] GET /identity/v3/role_assignments?user.id=b2080c582ab448d587b35d6a100cad12&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.085850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.113844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.145428 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.157280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52853fd-435f-4997-a5c5-dedf7cabad60 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.197484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.198290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.198578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.198894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.201995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55770a2-f878-467f-a231-29977df6ae65 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.210968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.212459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:09.230998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:09.231939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:09.232810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:09.232810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:09.232810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:09.232810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:09.232810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 257/522] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:09.233090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.246036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.246799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.247056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.247336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.248151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.248463 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.249945 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.266753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 266/523] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.266753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.348838 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588e3a-b54c-4679-8d97-80bf7387cbc2 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.350854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.377396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e317-3e5f-4e98-9fa9-e41757995c1b None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.390005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.390005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.390005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.390005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.399102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.400590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:09.416344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:09.417235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:09.418196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 258/524] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:09.419345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.423642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.424011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.424610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.424610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.425492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.426186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.426473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.427907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.440011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 267/525] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.441395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.536090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880c49-ad94-4272-8c13-6a400b1d861d None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.549173 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ea208-c1d6-42f2-9179-c64cb1807fc0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.578098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.578942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.579234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.579634 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.580589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=a3aa6ce16a904a6f9ebf67c6cd3e935b) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.580960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.582524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.585197 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.585860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.586147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.586426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.587302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.587615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.589673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 259/526] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/role_assignments?user.id=a3aa6ce16a904a6f9ebf67c6cd3e935b&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.590676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.597632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.608534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.618305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 268/527] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.619337 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.678495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.719529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7fda3-b4b9-4b6a-a808-e60f5b774c01 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.758396 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.759599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.760036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.760462 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.761921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ebdf5-4308-4090-b94a-c46972c1737a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.768744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.770515 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:09.787349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:09.788438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:09.789495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:09.791378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 260/528] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:09.797078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:09.814188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.814899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.815189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.815526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.816376 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=97d93a53678a488c91c017c500f9c4eb) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.816699 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.818473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.830773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 269/529] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/role_assignments?user.id=97d93a53678a488c91c017c500f9c4eb&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:09.918640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001f452-eac1-4829-a9fe-53cb299ade92 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:09.949233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:09.959044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:09.960138 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:09.960738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:09.961216 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:09.962251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:09.962792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:09.964484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b947-8495-435f-8ae2-136d60783286 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:09.984734 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 261/530] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:09.991139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:10.063081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:10.097960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5442e-309e-46db-85ef-6aa908f2a0a3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:10.133236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:10.133897 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:10.134182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:10.134455 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:10.135319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=f2a50a8a6aeb466fa87b4b8773658f3f) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:10.135631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:10.137086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11be09-25ef-47b7-aa7b-0ccda6fee75f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:10.146830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 270/531] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:09 2022] GET /identity/v3/role_assignments?user.id=f2a50a8a6aeb466fa87b4b8773658f3f&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:11.381953 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af717-6490-418f-98da-abbfb920518c None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.382502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af717-6490-418f-98da-abbfb920518c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.382502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af717-6490-418f-98da-abbfb920518c None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.383929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 262/532] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:11.396939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.397353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.397514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.415248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:11.416452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:11.484795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 271/533] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:11.509808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af717-6490-418f-98da-abbfb920518c None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:11.615684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af717-6490-418f-98da-abbfb920518c None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:11.651646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:11.652818 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.653313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.653823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.664617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:11.672799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:11.673646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:11.674420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:11.677279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 263/534] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:11.683431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:11.746459 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:11.793634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0bf5-e2d5-44e4-8250-a2c2eec87177 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:11.829421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:11.830085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.830369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.830650 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.831594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:11.831903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:11.833299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a4b9e-2220-4775-acc4-6c0934734328 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:11.842183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 272/535] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:11.847936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:11.902232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:11.950304 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ef58-d661-4934-ab5c-d8bb08aa054c None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.950602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ef58-d661-4934-ab5c-d8bb08aa054c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.950908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ef58-d661-4934-ab5c-d8bb08aa054c None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.952285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 273/536] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:11.957793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:11.958090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:11.958377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:11.974498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359e37-1147-46a5-8309-0d0662554460 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:11.977426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:11.978848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:12.026377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.027374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.027668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.027948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.039803 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.041293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:12.060018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:12.060875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:12.061740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:12.061740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:12.061740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:12.061740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:12.066071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 264/537] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:12.066981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.075380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 274/538] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:12.105183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.160384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.178923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.183329 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ca3c-f734-4a7d-9cd1-52d7fd209e7e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.220342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.220826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9ce42-0227-4ce1-a03d-281c9ed14a23 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.221003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.221293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.222122 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.222894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:12.223212 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.224624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683f1d9-0a81-4ef0-8b02-eba7ca09279f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.237440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 265/539] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:12.238872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af8c1-a854-43b8-8d73-01ce4a0a4058 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.239170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af8c1-a854-43b8-8d73-01ce4a0a4058 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.239456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af8c1-a854-43b8-8d73-01ce4a0a4058 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.241032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 266/540] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:12.243210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af8c1-a854-43b8-8d73-01ce4a0a4058 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.268804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.269713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.270007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.270207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.282903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-58e93fbc-3e5c-4f80-bf03-11db1bcb34f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:12.291257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:12.292168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:12.292950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 275/541] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:12.294478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.294478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.294478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.311410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:12.312587 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:12.363563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af8c1-a854-43b8-8d73-01ce4a0a4058 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.386753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 276/542] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:12.386753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.412073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.412798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.413079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.413354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.420557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.422007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.435056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-5e6b5086-b27a-4338-ae57-d441fae8d38a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:12.436121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:12.437116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:12.437961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 267/543] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:12.438924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71a5b-769b-4ae5-85c6-0dce4c5cb356 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.439206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71a5b-769b-4ae5-85c6-0dce4c5cb356 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.439497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a71a5b-769b-4ae5-85c6-0dce4c5cb356 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.441058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 268/544] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:12.441887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71a5b-769b-4ae5-85c6-0dce4c5cb356 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.460946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.500117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d762120-b21d-4e18-bd8d-8e09e82fb29c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.534997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.535924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.536104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.536386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.537138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:12.537451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.538870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.543688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a71a5b-769b-4ae5-85c6-0dce4c5cb356 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.546764 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 277/545] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:12.547537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.577564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.578346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.578629 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.578932 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.589577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8962a68e-c3c9-443c-81cd-832741c58c8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:12.597290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:12.598378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 269/546] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:12.604292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.605107 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.605107 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.616568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:12.617749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:12.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ec06-9603-4bfc-9142-a1957866d008 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.653168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.682052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 270/547] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:12.682836 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.685710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.687296 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.687699 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.688141 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.689084 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:12.689506 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.692094 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.693050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.713883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 278/548] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:12.714819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.785429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645bf8-c15e-4af3-94c5-dccb5feec93f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.817722 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e9de-4ed3-4c0c-90d1-a5243da91181 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.820506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.821301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.821581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.821857 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.832422 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.833883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:12.850903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:12.851786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:12.852649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:12.852649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:12.852649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:12.852649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:12.852875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.852970 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 271/549] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:12.853043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.853043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.853170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.853241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.853792 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:12.854026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:12.855445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:12.864181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 279/550] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:12.864978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:12.889521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.919980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:12.962248 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f06075-d8a0-400a-aa43-ef86f3bbdda6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.963701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bc14a-d361-4f2a-88d6-7845b12828c4 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:12.995694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.996489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.996771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.997056 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:12.998336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:12.999162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:12.999440 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:12.999752 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.008149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:13.012853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.014526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:13.015876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.016807 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 272/551] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.017960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:13.036465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.037634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 280/552] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.038559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.114793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.115446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753753b7-8883-40bd-ab8b-bf74595ca7be None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.135950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.141828 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9274-3527-466e-97bd-7e4fb674515a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.150472 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.151170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.151454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.151734 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.152469 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.152782 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.154161 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.165631 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 273/553] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.166413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.176453 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.177244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.177532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.177816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.188477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.189952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:13.207426 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.208516 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 281/554] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.209391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.270318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b79abd-ccda-4e4a-ae25-64d6b9c30e59 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.304679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.305507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.305889 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.306235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.307158 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.307548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.308981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.311253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3f0a6-751f-48fd-940d-18e2a14ddab3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.321336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 274/555] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.321336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.336717 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.346099 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.347333 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.347620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.347896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.348627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.348937 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.350323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.361339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 282/556] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.362780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.363909 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.420837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e6031-9f69-4317-8990-ad228913666c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.453494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.454277 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.454559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.454876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.462574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.464058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.466591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa559ae-28d4-4bc1-a076-ae1970e9638f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:13.478430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.479377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:13.480287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:13.482982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 275/557] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.483741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.500814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.501473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.501767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.502055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.502964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.503287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.504665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.516213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 283/558] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.517002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.563985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.585525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9bd5-7947-4dc7-a515-8deec8b18559 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.587044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.617235 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf99b8-c8eb-4d1d-9705-6103b4e7a546 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.623317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.624091 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.624378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.624659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.634825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.636275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.651208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:13.654667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.655817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.656863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:13.656863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:13.656863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:13.656863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:13.657349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.657349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.657349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.658840 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 276/559] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.660484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.665760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.667271 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:13.680961 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.681850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:13.682806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 284/560] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.683301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.761526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aaa32-2161-4aae-8f38-17333d2da930 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.782258 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a318cf-b1b7-49f7-9a30-87907ead272d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.790466 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.795188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.795857 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.796146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.796429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.797272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.797582 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.799040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.815913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 277/561] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.816477 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.821210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.822001 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.822283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.822558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.829760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.830494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:13.832041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:13.847860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:13.848895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:13.849920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 285/562] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:13.850502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:13.931891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485fa4e-a92c-443d-a1c8-6c275d7e6088 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.973679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94b67-85e5-4d33-91d9-441b15ab2519 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:13.976405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:13.977079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:13.977367 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:13.977645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:13.978378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:13.978688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:13.980094 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:13.993116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 278/563] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:13.994098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.016136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.017104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.017557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.017820 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.019234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:14.019538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.021219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.038080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 286/564] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:14.038990 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.066431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.077780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.109937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591dca-aff6-4e68-a439-ad447fefda4b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.137595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008944c9-493c-48b5-b50f-8b7bc5d9f4c8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.142741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.144077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.144381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.144665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.155104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.156574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.170918 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.171581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.171867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.172154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.172977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:14.173275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:14.174284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:14.175255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:14.175255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:14.175255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.175255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:14.175484 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.175556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 279/565] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:14.175629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.175698 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.193079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 287/566] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:14.193906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.275088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.278064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158d8d9-1db9-4c88-8b15-5535d9a68d5b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.290970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45104-44d4-4e7b-8f27-0da902fcacd7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.300669 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.311730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.312516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.312797 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.313071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.321804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.323241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.325759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.326627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.326942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.327218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/b2080c582ab448d587b35d6a100cad12/roles/1b713919183e4aaf9570acd2c4b8648e` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:14.337874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:14.338974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 280/567] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:14.339913 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.344342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=b2080c582ab448d587b35d6a100cad12, role_id=1b713919183e4aaf9570acd2c4b8648e)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.345803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.358414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 288/568] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:02:14 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/b2080c582ab448d587b35d6a100cad12/roles/1b713919183e4aaf9570acd2c4b8648e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:02:14.359093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.471265 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e33603-1bcc-4b96-aa78-d313e3cb46e5 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.481126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcda02b-7cc3-4b94-9e1f-13e37f5e1e49 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.512045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.512835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.513124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.513413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.514156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:14.514475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.515981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.520835 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.521644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.521929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.522208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.524445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.530594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 281/569] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:14.531678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.539130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.541819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:14.561592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:14.562772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:14.563883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:14.563883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:14.563883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.563883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:14.565005 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 289/570] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:14.566494 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.591565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.650412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b3c9f-d301-4a02-b8e5-160ce47ce1bb None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.672227 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72fd85-1af5-4737-99df-44623716ed55 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.686101 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.686804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.687096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.687378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.688225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:14.688539 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.689968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.712348 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 282/571] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:14.712348 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.717069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993b967-441c-4475-8621-c168d5770395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.717867 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b967-441c-4475-8621-c168d5770395 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.718155 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b967-441c-4475-8621-c168d5770395 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.718452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b967-441c-4475-8621-c168d5770395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.726305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993b967-441c-4475-8621-c168d5770395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.728178 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993b967-441c-4475-8621-c168d5770395 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9993b967-441c-4475-8621-c168d5770395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:14.743826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:14.744766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:14.745619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:14.749707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 290/572] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:14.750826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993b967-441c-4475-8621-c168d5770395 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.800389 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.821162 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b34e8f-d146-4ebe-8ead-220b5036563f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.823213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:14.858626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993b967-441c-4475-8621-c168d5770395 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:14.860137 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.860806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.861088 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.861367 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.862121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:14.862433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.863837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.876854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 283/573] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:14.878214 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.902186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:14.903159 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:14.903448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:14.903727 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:14.915234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:14.916715 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:14.934525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:14.935556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:14.936443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:14.936443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:14.936443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:14.936443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:14.936443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 291/574] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:14.937259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:14.988294 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36590-94bc-42a4-b1d2-8172b0f88413 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.023899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.024711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.025086 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.025473 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.026357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:15.026798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.028345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.042802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 284/575] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:15.043928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.048406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.052958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f13cf-b31d-466f-b6e7-3fae8de3e712 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.071729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.090507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.091337 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.091621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.091902 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.099434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.100887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:15.115079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:15.116134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 292/576] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:15.121874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.161142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a427-e438-4c71-b562-8399f0413dd5 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.203200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.204071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.204354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.204628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.205338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:15.205643 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.207545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.223630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 285/577] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:15.223630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.228560 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fdbc8-723a-40a7-bcac-ef3a09280e86 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.263856 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.264738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.265026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.265305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/a3aa6ce16a904a6f9ebf67c6cd3e935b/roles/1b713919183e4aaf9570acd2c4b8648e` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.280409 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=a3aa6ce16a904a6f9ebf67c6cd3e935b, role_id=1b713919183e4aaf9570acd2c4b8648e)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.281865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.302731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 293/578] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:02:15 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/a3aa6ce16a904a6f9ebf67c6cd3e935b/roles/1b713919183e4aaf9570acd2c4b8648e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:02:15.302731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.307289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.322410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.354175 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19ae1-d260-4713-8825-7b3caed2165c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.410571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.411476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.411865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.412345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.413356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:15.413775 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.415418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.430628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 286/579] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:15.436844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffb114-f948-4a53-897c-a1ae802dd545 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.437069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.477704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.478503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.478817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.479100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.492434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.495037 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:15.513682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:15.514615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:15.515593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:15.516221 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 294/580] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:15.521820 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.559506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a487-9ba5-4f25-9723-33bb374751dc None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.598464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.600866 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.602630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.602945 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.603217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/97d93a53678a488c91c017c500f9c4eb/roles/1b713919183e4aaf9570acd2c4b8648e` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.622412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=97d93a53678a488c91c017c500f9c4eb, role_id=1b713919183e4aaf9570acd2c4b8648e)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.624496 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.629365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:15.655048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a2f5e-d20c-4771-89cf-6aba3118b100 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.656180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 287/581] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:02:15 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/97d93a53678a488c91c017c500f9c4eb/roles/1b713919183e4aaf9570acd2c4b8648e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:02:15.702748 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.703878 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.704366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.704875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.706471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:15.707041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.708798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67bab-820d-40ad-8d9d-69b15e281ea5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.724090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 295/582] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:15.730879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:15.850523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae869e-6e19-4b68-9cba-b8657388d5df None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:15.890163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:15.891084 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:15.891375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:15.891661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/f2a50a8a6aeb466fa87b4b8773658f3f/roles/1b713919183e4aaf9570acd2c4b8648e` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:15.907280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=f2a50a8a6aeb466fa87b4b8773658f3f, role_id=1b713919183e4aaf9570acd2c4b8648e)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:15.908657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0743f2-20a4-4cd2-929a-6719776651c2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:15.925876 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 288/583] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:02:15 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/f2a50a8a6aeb466fa87b4b8773658f3f/roles/1b713919183e4aaf9570acd2c4b8648e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:02:16.665490 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5697d7-ecf0-46dc-a7c1-ebe8aa97cc67 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:16.666007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5697d7-ecf0-46dc-a7c1-ebe8aa97cc67 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:16.666223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5697d7-ecf0-46dc-a7c1-ebe8aa97cc67 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:16.668028 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 296/584] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:16.673379 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:16.673791 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:16.674149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:16.692081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:16.693281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:16.729010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:16.763937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 289/585] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:16.788874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5697d7-ecf0-46dc-a7c1-ebe8aa97cc67 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:16.900707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5697d7-ecf0-46dc-a7c1-ebe8aa97cc67 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:16.928520 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:16.937158 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:16.937963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:16.938255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:16.938552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:16.949636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:16.958222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:16.959201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:16.960021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 297/586] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:16.965633 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.073391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0094025-3313-4687-a0be-fd38a3979367 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.113178 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.114228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.114842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.115399 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.116348 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:17.116858 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:17.118431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:17.128482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 290/587] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:17.134138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.235076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd84ba-7c25-45ad-ad3c-3ec70113d923 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.269821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.271018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.271578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.272055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.283466 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:17.285244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:17.303067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:17.303958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:17.304821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:17.304821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:17.304821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:17.304821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:17.311038 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 298/588] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:17.312860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.350474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:17.419975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480351d-42fe-40b1-a251-5d70b7040633 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.455027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.456203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.456492 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.456767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.457494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:17.457800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:17.459190 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:17.471709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 291/589] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:17.477093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.521616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:17.590788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088816-2257-46ef-b293-3ee12a56ceae None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.625692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.626486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.626795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.627073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.635039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:17.636505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-c6d2febc-037b-46e1-b7ed-ffddad85c1ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:17.651676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:17.652637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:17.653750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 299/590] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:17.660346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.697616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2b6-307b-46c7-ad26-8d8dcdee1cfc None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.698720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2b6-307b-46c7-ad26-8d8dcdee1cfc None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.699197 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2b6-307b-46c7-ad26-8d8dcdee1cfc None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.700939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 300/591] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:17.707368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.707765 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.708146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.729760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:17.731600 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:17.771176 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:17.775776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ffd7-41a5-4156-9aa1-bdd19905cf83 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.813092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.813915 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.814259 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.814599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.816071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:17.816495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:17.818050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:17.819042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 301/592] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:17.836616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.837435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 292/593] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:17.843136 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:17.871123 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:17.944084 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364c4d4-ad95-4ddc-8608-af81f32ef86d None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.954750 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720c9e-43f9-4813-93f2-3add1c1dda79 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:17.980432 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.981335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.981687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.982046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:17.992467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:17.992790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:17.993122 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:17.993411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:17.993688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:18.001042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.003549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.005622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:18.014808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 302/594] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.017107 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.019692 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.069930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.071439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.119764 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.131670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbec47-aed9-4012-9c46-4d6ffaf14f5f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.168762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.169481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.169769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.170058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.170858 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:18.171171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.172555 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966f5b-f71d-44f1-bfd1-097d3c493744 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.185458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 303/595] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:18.185458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478ec9-f61c-4c92-9d05-38d133a789ed None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.185458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478ec9-f61c-4c92-9d05-38d133a789ed None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.185458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478ec9-f61c-4c92-9d05-38d133a789ed None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.185458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 304/596] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:18.186454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 293/597] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 10:02:18.190840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478ec9-f61c-4c92-9d05-38d133a789ed None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.191030 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.247444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.295789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946141f-9a50-4e9b-8c79-4e368b507714 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.298222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478ec9-f61c-4c92-9d05-38d133a789ed None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.328247 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.328967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.329250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.329527 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.331753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.332524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.332807 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.333090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.340621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.342070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.342957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.344605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-d42c05aa-0e2d-49ea-a1c6-cc15cf5353e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:18.360127 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.360984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.361846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:18.361846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:18.361846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:18.361846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:18.361846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 294/598] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-cdea6dfe-63de-4378-b117-e7e722d3d3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:18.362163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.363349 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.364544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:18.364544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:18.364544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:18.364544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:18.364848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36cd8-bcb0-407d-bb33-991197d60882 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.364848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36cd8-bcb0-407d-bb33-991197d60882 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.364848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36cd8-bcb0-407d-bb33-991197d60882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.365090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 305/599] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.365090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4673-c9b9-4178-9441-69901964d2c7 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.365090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4673-c9b9-4178-9441-69901964d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.365090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c4673-c9b9-4178-9441-69901964d2c7 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.366404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 306/600] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:18.367181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c4673-c9b9-4178-9441-69901964d2c7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.371329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.385244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-62a36cd8-bcb0-407d-bb33-991197d60882 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:18.386424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-62a36cd8-bcb0-407d-bb33-991197d60882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:18.453542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 295/601] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:18.454887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.455179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.455460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.474680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c4673-c9b9-4178-9441-69901964d2c7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.486309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:18.487570 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:18.510890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.511552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.511847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.512130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.512858 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:18.513171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.514552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.515639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.526187 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 307/602] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:18.527010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.557644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 296/603] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:18.558475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.595150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.634682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9891b8-bba7-4c78-b44f-6df224194529 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.660140 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a392056-3b7c-4550-8588-2534b20d47dc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.667863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.668520 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.668802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.669078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.669804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:18.670108 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.671532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.683025 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 308/604] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:18.683877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.694551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.695380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.695673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.695951 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.705893 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:18.713478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.714438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.715498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:18.719559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 297/605] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.720262 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.745545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.781448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450b80-9d86-4188-8a80-5f4ecc0b3bc5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.804825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.816243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.817034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.817322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.817599 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.823054 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7123-7787-455e-999a-80f247594e76 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.824640 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.826090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:18.840637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.841694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:18.842611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 309/606] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.843234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.857096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.857811 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.858345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.858345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.868131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:18.876491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:18.877654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 298/607] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:18.878497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:18.948016 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dd728-d608-48ce-92f3-d444e1e99436 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.962624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:18.979144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17edc-ab33-4b3e-bcb9-0019c0e7472c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:18.981404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:18.982185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:18.982462 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:18.982760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:18.989996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:18.991471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:19.006375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:19.007286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:19.008154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 310/608] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:19.009125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.017403 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.018083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.018456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.018759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.019512 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.019824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.021208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.029405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 299/609] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.030188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.058858 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.112833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10d56-ce76-4e69-bc52-46beac2d30ce None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.128423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8ec7-d938-4b97-bef5-cfcc5fef6f50 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.146298 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.146996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.147288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.147565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.148400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.148732 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.150157 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.162193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.162895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.163186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.163466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.164213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.164523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.165890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.167002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 311/610] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.167793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.175585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 300/611] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.176393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.188051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.265302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d425-f12f-4cd3-ad26-ed4a5ffdb203 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.266939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.275883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0926-f2eb-4780-9328-be0ce8fa9dff None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.300505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.301156 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.301442 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.301720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.302509 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.302851 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.304293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.308673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.309450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.309739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.310017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.316234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 312/612] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.316847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.325256 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.326697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:19.343785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:19.344652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:19.345772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:19.345772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:19.345772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:19.345772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:19.345772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 301/613] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:19.346833 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.409368 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.421969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0b94-4754-4079-830d-b8a23db43d13 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.449757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928544c7-4a90-4e28-bb4d-00c8baa47010 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.454650 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.455317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.455621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.456429 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.483502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.484277 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.484562 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.484832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.485312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.495461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.496907 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:19.514157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:19.515145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:19.516017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:19.516017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:19.516017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:19.516017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:19.516017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 302/614] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:19.516296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.527907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.529369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.613462 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6857-246f-4e64-a9f5-9b0f87a0ca9d None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.624709 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 313/615] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:19.625962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.626097 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.651086 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.651661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.651947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.652224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.653045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=b2080c582ab448d587b35d6a100cad12) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.653358 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.654803 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.660505 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 303/616] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/role_assignments?user.id=b2080c582ab448d587b35d6a100cad12&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.661266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.709908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.757255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9623-cebd-457c-af2a-ed4487ad7a85 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.779089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b30b4-b13d-4e07-ac41-2a19fe6973d8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.798215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.798938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.799230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.799545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.800405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.800721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.802121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.816056 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.816456 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 314/617] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.817036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.817323 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.817601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.818342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:19.818655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.820089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:19.821791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.836008 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 304/618] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:19.836739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:19.876215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.945821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f51c-8bd3-4691-a8ee-ed872b28b3a8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.955864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70471b2-52a7-4434-a599-482401d4bc3f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:19.971301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:19.982451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.983278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.983555 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.983827 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.994011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:19.994986 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:19.995163 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:19.995281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:19.995535 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:19.996634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.004239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.006067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:20.014316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:20.015359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:20.016238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:20.016238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:20.016238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:20.016238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:20.016238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 315/619] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:20.016843 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:20.021234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:20.022229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 305/620] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:20.023480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.128133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff6a71-0f74-493f-951d-3ce34b1a92b1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.130336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.137602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22b82a-8dcd-4a3f-ac36-73130fe351dd None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.163762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.164559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.164842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.165123 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.172726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.173355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.174187 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.175044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.175530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.176005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.177028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:20.177620 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.179010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:20.189056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:20.190139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:20.195887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 316/621] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:20.196489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 306/622] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:20.196489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.196626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.233498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.304284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df0212-4745-4ee2-9669-344166ee6863 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.304783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec4ce7-9de9-4e56-aba7-5c9209b3cce7 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.338989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.339652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.339934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.340211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.341041 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:20.341351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.341743 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.342408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.342688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.342800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.342988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.343978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:20.344548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.347307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.361551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 307/623] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:20.363946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.367545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 317/624] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:20.368293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.388577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.475134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.478103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55ad8-ae3b-42f6-a46d-f0b6d83b6f8e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.488362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6513e4-bd45-4eaf-9896-d69a00504d93 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.515378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.516507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.516995 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.517325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.525279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.526748 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.530969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.531746 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.532171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.532638 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:20.541524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:20.542388 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:20.543311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 308/625] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:20.543788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.608395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.609855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.634558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.662203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d5de-204b-49e8-ac0e-c857fb8625f6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.697071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.697716 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.698008 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.698284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.706545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.718687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 318/626] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:20.719742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.769621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.771142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.824920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e690f6-09b6-400d-a1d4-c4ae10540736 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.854355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.862195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:20.862905 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:20.863189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:20.863467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:20.864278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:20.864642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:20.866087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:20.879441 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 319/627] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:20.880291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.891590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 309/628] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:20.892706 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:20.942138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:20.992962 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec8c83-ac16-4475-918a-bcb0a4fb301a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:20.999547 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d0313-6d36-4fac-af7a-bb35ea9efb09 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.029297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.030257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.030420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.030577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.041685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.042537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.042858 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.043149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.043718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.043993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=a3aa6ce16a904a6f9ebf67c6cd3e935b) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:21.044311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.045413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.045742 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.052162 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 310/629] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/role_assignments?user.id=a3aa6ce16a904a6f9ebf67c6cd3e935b&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:21.052781 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:21.079564 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:21.080604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:21.081571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:21.081571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:21.081571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:21.081571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:21.085302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 320/630] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:21.090951 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.106445 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.175645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249371f-b296-43b3-a8bb-d7cdade53d4b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.223981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.225351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.226173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.226454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.229959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc81ad-8008-4ca9-b01c-eea0579be304 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.233999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.241378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.242882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:21.261263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:21.262173 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:21.263460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:21.263460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:21.263460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:21.263460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:21.263460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 311/631] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:21.269083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.278069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.280486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.280486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.280486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.280486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:21.283126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.283496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.300726 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 321/632] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:21.306526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.430466 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af4de3-603c-4c06-8f27-9eba7af0a159 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.474507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.476087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.476627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.477029 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.487400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.489003 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.507581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:21.510383 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:21.511443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:21.512517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:21.514966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 322/633] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:21.519831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.523270 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbccbb-5480-4f5f-953c-b3b36e8095db None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.556960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.567280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.568010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.568362 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.568742 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.569523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:21.569897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.571430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.585390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 312/634] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:21.590418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.664536 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30397fd-1a51-4fc9-bb69-7eb0a2448ca0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.700977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e2180-5b44-487f-8182-5a9cf521de83 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:21.709252 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.710117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.710548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.710999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.712421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:21.712889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.715214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.745302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 323/635] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:21.748658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.777611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:21.778420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:21.778720 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:21.779010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:21.794078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:21.796146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:21.822728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:21.823622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:21.824516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:21.835180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 313/636] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:21.835929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:21.865281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.935076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:21.965211 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc68c6-1130-4eb2-9d39-9a121a16c576 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.031208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaa78a-a3d5-450a-a7fa-16762cb859b3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.032373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.033346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.035678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.035963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.036811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=f2a50a8a6aeb466fa87b4b8773658f3f) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:22.037575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.038737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf88467-7ba0-4516-b7bc-b1a5769b93c2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.051991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 324/637] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/role_assignments?user.id=f2a50a8a6aeb466fa87b4b8773658f3f&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:22.053293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53154-ddb2-42b1-9a29-5fc9acc25f39 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.053581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53154-ddb2-42b1-9a29-5fc9acc25f39 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.053856 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53154-ddb2-42b1-9a29-5fc9acc25f39 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.059678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 325/638] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:22.061131 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.061420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.061703 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.079705 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:22.081387 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:22.089699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.090925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.091646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.092120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.093195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:22.093917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.098045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.117009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 314/639] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:22.123400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:22.163185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 326/640] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:22.182335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:22.221974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:22.262478 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceb976-1db1-403c-8f72-73e5fb3fc76f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.268993 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:22.293148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2848d-a0cb-46d8-a071-382335afaf37 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.313223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.315645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.316131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.316624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.317667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=97d93a53678a488c91c017c500f9c4eb) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:22.318289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.319976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.327830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 315/641] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/role_assignments?user.id=97d93a53678a488c91c017c500f9c4eb&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:22.337346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.338721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.339057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.339339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.355805 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:22.364980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:22.366034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:22.367400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 327/642] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:22.372813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:22.487736 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e714-6d62-4967-ab26-5abd8e321d85 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.524238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.524903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.525185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.525458 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.526199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:22.526508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.529236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.529786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:22.540214 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 316/643] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:22.545631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:22.658807 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd508-c549-44a0-a360-ab0f16b638e7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.694489 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.695665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.696171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.696645 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.703880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:22.709942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.711667 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:22.732092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:22.733024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:22.733894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:22.733894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:22.733894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:22.733894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:22.733894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 328/644] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:22.739749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:22.843984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff7e42-95b3-4cae-b382-1c1a48d03ba8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:22.878907 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:22.880316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:22.880780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:22.881233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:22.882149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:22.882643 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:22.884397 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:22.897854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 317/645] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:22.903185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.009577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10fbd2-b115-4f39-b66d-b2df1bff471d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.046231 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.047049 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.047331 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.047603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.056192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.058083 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:23.073989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:23.074966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:23.075912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 329/646] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:23.082157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.146166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:23.191454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd69a6-5e0f-418e-a512-bf98fedba5b4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.228070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.228749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.229032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.229312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.230154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:23.230468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.231934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:23.249446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 318/647] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:23.255945 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.310845 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:23.368920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7882949-cecf-482c-a5c8-b33d4f59e7b1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.407103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.407761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.408042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.408321 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.484952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.486421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34684635-26ed-4657-a0b6-1cd687e2260d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:23.537540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:23.592821 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 330/648] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 10:02:23.599374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.606249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc4b-c17e-4253-974c-e8029284e598 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.606560 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc4b-c17e-4253-974c-e8029284e598 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.606849 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc4b-c17e-4253-974c-e8029284e598 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.608461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 331/649] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:23.614109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.614406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.614683 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.633740 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:23.635159 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:23.708712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 332/650] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:23.712900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda463-2aca-44ae-a0ea-07d85f811f46 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.727877 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:23.733319 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.753275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.754983 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.755504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.755974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.768869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.771402 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:23.797764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:23.798741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:23.800319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:23.800319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:23.800319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:23.800319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:23.806258 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 319/651] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:23.807990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.831747 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:23.854249 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bde5f-7431-48e9-a5c5-04b2e6c2d4ac None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.902724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.902724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.902724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.902724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.903134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.903134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:23.914795 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:23.915796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:23.916798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 333/652] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:23.922044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:23.945544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cad265-4227-45c1-8039-2b7109823697 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:23.989991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:23.990811 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:23.991101 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:23.991381 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:23.992110 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:23.992420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:23.994400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.011792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 320/653] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:24.017006 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.050120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262030-23c4-47f8-bbc9-cf05732a25c7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.054353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.093560 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.094879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.095362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.095857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.097368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:24.097875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.099500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.104813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 334/654] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:24.118212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.121412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.150196 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517423cb-99b9-4e74-9049-b8c21a6dea31 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.197349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.198696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.199007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.199287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.209750 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.211288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.225267 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baea2-878a-4d2a-8792-37db69a3f5a0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:24.230579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:24.231460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:24.232551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 321/655] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:24.239547 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.264644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.265577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.265891 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.266265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.267121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] RBAC: Adding query filter params (type=image) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:24.267515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.269528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.283007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 335/656] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:24.339778 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.367041 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6eebf-cda3-4338-baaa-607325fa6698 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.408219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.409541 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.409827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.410104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.410949 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:24.411263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.412745 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d5bc1-d975-45af-8715-b61e3136b15f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.427914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 322/657] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:24.433948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.512044 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.516227 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4918a-9b9c-496e-ab14-f3f35b1e81c9 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.516520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4918a-9b9c-496e-ab14-f3f35b1e81c9 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.516801 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4918a-9b9c-496e-ab14-f3f35b1e81c9 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.518356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 323/658] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:24.523727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.524016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.524296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.542184 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:24.543711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:24.544421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee83a-0092-4656-a252-00b1ff8d5437 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.580845 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.581505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.581784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.582056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.583027 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=b2080c582ab448d587b35d6a100cad12) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:24.583342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.584895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.598819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 336/659] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/role_assignments?user.id=b2080c582ab448d587b35d6a100cad12&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:24.621133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 324/660] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:24.645351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.770727 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02966d-0e3e-413a-8ba3-aa47c22ca9f1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.808214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.809012 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.809294 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.809575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] PATH_INFO: `/v3/services/network` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.810241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.811653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.814691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-28a17be4-9bac-4026-b5f3-afc272576f82 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:24.824721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:24.825759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:24.826571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 337/661] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:24.834124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:24.878278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c010-02b9-43a7-92a0-10299d5926a2 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.878562 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c010-02b9-43a7-92a0-10299d5926a2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.878793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c010-02b9-43a7-92a0-10299d5926a2 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.880292 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 338/662] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:24.887380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.887380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.887380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.906525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:24.908087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:24.921157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:24.947466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0e4b4-d714-42d6-a01d-0d6656bbbfc5 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:24.986902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:24.987747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:24.988135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:24.988423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:24.989139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] RBAC: Adding query filter params (name=network) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:24.989450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:24.991457 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:24.997931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 325/663] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:25.010481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 339/664] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:25.010677 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:25.030054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:25.138561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9218-5665-4978-a3b9-08de9401bba6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:25.157420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489fedc-50c3-4b12-a382-53ef089e508a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:25.182399 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:25.183414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:25.183769 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:25.184545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:25.185471 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:25.185952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:25.188118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:25.190513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:25.197233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 326/665] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:25.198528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:25.199399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:25.199685 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:25.199967 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:25.200641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:25.202057 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:25.216403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:25.217420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:25.218246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 340/666] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 12 10:02:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:25.225298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:25.240657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:25.337152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639f79-e347-4afd-ab1a-06540f5699a4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:25.374525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:25.375503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:25.375792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:25.376072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:25.376796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:25.377110 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:25.380340 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4b15f-421f-4202-8b4b-c1265da9eeb2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:25.384521 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 327/667] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:25.390081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:25.500025 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545f70-7633-4d7b-9d90-d933411beca9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:25.538151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:25.538865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:25.539148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:25.539424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:25.540139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:25.540448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:25.541835 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8bac-7702-4ee4-86e4-c8b4ddcdb947 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:25.547043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 341/668] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:26.638311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9345-db09-4733-b677-3efad5e982f1 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:26.638841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9345-db09-4733-b677-3efad5e982f1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:26.638916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9345-db09-4733-b677-3efad5e982f1 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:26.640527 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 328/669] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:26.646450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d38-cf2a-49c1-897e-ed5dd210e8e6 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:26.646895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d38-cf2a-49c1-897e-ed5dd210e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:26.646973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c7d38-cf2a-49c1-897e-ed5dd210e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:26.664678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-492c7d38-cf2a-49c1-897e-ed5dd210e8e6 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:26.665886 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-492c7d38-cf2a-49c1-897e-ed5dd210e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:26.728706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:26.745869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 342/670] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:26.770295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9345-db09-4733-b677-3efad5e982f1 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:26.843283 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:26.877090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20de1-bfc9-4442-9059-80be573463fb None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:26.877728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20de1-bfc9-4442-9059-80be573463fb None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:26.878204 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20de1-bfc9-4442-9059-80be573463fb None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:26.879864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9345-db09-4733-b677-3efad5e982f1 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:26.881315 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 343/671] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:26.885522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:26.886035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:26.886509 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:26.906168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:26.908250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:26.914662 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:26.915365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:26.915651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:26.915928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:26.916648 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:26.918079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:26.938261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 329/672] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:26 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:27.002972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 344/673] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:26 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 10:02:27.021404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.135041 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a7334-199f-4eef-9508-9d29775aea10 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.161914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:27.170318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.171309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.171597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.171973 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.187036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:27.195282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:27.196188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:27.196999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 330/674] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:27.203021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.317352 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2244ae-5317-4452-a51a-08d7b18e3e3f None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.332738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:27.354081 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.355121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.355628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.356176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.357136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:27.357641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:27.359255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:27.368739 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 345/675] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:27.374617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.488575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3d63b-d116-450e-967d-420b25dc742a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.524343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.525141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.525429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.525707 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.538274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:27.539796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c1fbed34-257f-43b5-a8e7-e697f9fadb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:27.557948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:27.558900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:27.559767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:27.559767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:27.559767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:27.559767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:27.559767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 331/676] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:27.566093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.608188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffe43-7fac-4503-9f0b-4b7fcba3858f None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.608497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffe43-7fac-4503-9f0b-4b7fcba3858f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.608749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffe43-7fac-4503-9f0b-4b7fcba3858f None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.610483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 332/677] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:27.616200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.616491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.616777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.634648 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:27.636079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:27.670170 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07608d9-368f-4926-9521-97f5a45cfc5e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.673948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:27.707892 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.708572 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.708860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.709132 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.709885 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:27.710195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:27.711661 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:27.719003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 333/678] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:27 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:27.725721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 346/679] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:27.730952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.741940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.815729 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:27.860670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d451e-b032-4ab6-958f-410b58900d61 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.874051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58b350-5857-433a-8886-ba4a50eb5dc7 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:27.899360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.900028 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.900316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.900598 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.901344 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:27.902747 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6474-1f3f-4440-9a80-0a190836ef1c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:27.911330 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:27.912516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.912978 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.913407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] PATH_INFO: `/v3/users/nova` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.917813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 347/680] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:27 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:27.919183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8fece-b6a7-4be1-baf9-7ca10e7379ad None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.919482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8fece-b6a7-4be1-baf9-7ca10e7379ad None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.919767 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8fece-b6a7-4be1-baf9-7ca10e7379ad None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.925357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 348/681] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:27.925538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:27.925538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:27.928355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:27.928882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:27.929346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:27.941135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:27.942254 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:27.943238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 334/682] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:27.948993 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:27.960935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:27.963452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:27.993186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:28.078951 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 349/683] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:27 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 10:02:28.098504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0257327-c64d-45de-ac56-d5d74c296cba None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.104010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:28.130488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:28.157009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.157694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.157986 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.158266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.159899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:28.160222 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.161664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.184456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 335/684] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:28.189813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:28.234248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d31a19-598b-4756-b914-cccf9c88563e None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.292154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:28.307282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa93613-e785-4f1b-9ece-cf9e7ed7af3c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.351419 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.352491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.352962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.353391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.365729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.367472 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:28.393391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:28.394324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:28.395943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:28.395943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:28.395943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:28.395943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:28.395943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 336/685] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:28.402111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:28.423694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.424810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.424921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.425554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.426265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.427706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.445694 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 350/686] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:28 2022] POST /identity/v3/services => generated 251 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:02:28.526808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482e2-34c6-4d64-b50b-19ba4c2031eb None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.579514 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.581133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.581629 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.582139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.583126 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:28.583627 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.585225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.588310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:28.599784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 337/687] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:28.608101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:28.692709 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:28.713641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff832-0a89-4006-b4b9-a74a90ed105c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.747972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.748766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.749143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.749419 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.756875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.758406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:28.772735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:28.773610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:28.774929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 351/688] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:28.779890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:28.886662 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79ea4d-f94d-43e2-8c0f-5b9fcd999b20 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:28.922329 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:28.923311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:28.923772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:28.924274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:28.925229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:28.925713 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:28.927337 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5dad0-56da-4f10-aa0b-2a0e00cbcf21 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:28.940251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 338/689] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:28.946317 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:29.052124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052596a-c8ba-42cb-ae4a-ec74ce6bcc1a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:29.088776 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:29.089666 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:29.089958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:29.090244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/b2080c582ab448d587b35d6a100cad12/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:29.092288 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=b2080c582ab448d587b35d6a100cad12, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:29.093744 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37919d-8e49-4d91-abdd-db924e350c9e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:29.110060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 352/690] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:02:28 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/b2080c582ab448d587b35d6a100cad12/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:02:29.413757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca613-b9ee-4e7d-81ae-2bf52c286c87 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:29.414150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca613-b9ee-4e7d-81ae-2bf52c286c87 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:29.414504 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca613-b9ee-4e7d-81ae-2bf52c286c87 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:29.416306 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 339/691] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:29.421622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:29.421923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:29.422210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:29.427912 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:29.446136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:29.447380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:29.518639 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 353/692] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:29.541285 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca613-b9ee-4e7d-81ae-2bf52c286c87 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:29.601245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:29.649425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca613-b9ee-4e7d-81ae-2bf52c286c87 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:29.685552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:29.686690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:29.687268 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:29.687749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] PATH_INFO: `/v3/services/image` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:29.688605 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:29.690273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:29.704239 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:29.705863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:29.706723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:29.709611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 340/693] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 12 10:02:29 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:29.715451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:29.820679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ab1b-0034-4aac-b70d-0a9dcfdde646 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:29.856126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:29.861598 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:29.863222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:29.863822 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:29.864103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:29.864814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] RBAC: Adding query filter params (name=image) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:29.865440 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:29.866842 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:29.871857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 354/694] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:29.877641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:29.986205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b94041-7cd9-4227-9dca-74618f479317 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:30.007075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:30.021237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:30.021902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.022185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.022466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.023204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] RBAC: Adding query filter params (type=image) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:30.023511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:30.024872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:30.030148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 341/695] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:30.036312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:30.141585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02464cb-a733-496d-aa68-e8f2b49a0cfb None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:30.176640 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:30.177299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.177580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.177855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.178648 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] RBAC: Adding query filter params (interface=public, service_id=bc4c9d698e2e4d4391eb069850baeffb, region_id=RegionOne) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:30.178988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:30.180372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f0d7-fbfa-4170-838a-b013f7d45a60 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:30.188681 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 355/696] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:30 2022] GET /identity/v3/endpoints?service_id=bc4c9d698e2e4d4391eb069850baeffb&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:30.194326 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:30.306215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a703-8b91-4448-8e02-87879493f716 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:30.342319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:30.343420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.343997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.344473 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.345465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:30.347111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00e09-648f-465d-a678-5ba4be144d37 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:30.354671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 342/697] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:30 2022] GET /identity/v3/services => generated 1002 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:30.398144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac21c-b0f5-4037-b94e-341454d4cef7 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.398803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac21c-b0f5-4037-b94e-341454d4cef7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.399475 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac21c-b0f5-4037-b94e-341454d4cef7 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.402050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 356/698] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:30.407475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.408080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.409188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.427865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:30.429484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:30.479656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:30.507788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 343/699] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:30.531879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac21c-b0f5-4037-b94e-341454d4cef7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:30.599388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:30.643761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac21c-b0f5-4037-b94e-341454d4cef7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:30.679519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:30.680313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.680595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.680871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.681524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:30.682936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:30.695642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:30.696631 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:30.697431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 357/700] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:30 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:30.702747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:30.807939 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554256ec-7b1c-4de1-af63-39a9004eb2ac None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:30.845805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:30.846859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.847318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.847768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.848645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] RBAC: Adding query filter params (name=network) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:30.849193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:30.850881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf06102-9a0b-4dc3-9c6a-449496bf869a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:30.856273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 344/701] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:30.862128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:30.892475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015866c-8d6e-45cf-a553-7ec25a69325a None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.893044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015866c-8d6e-45cf-a553-7ec25a69325a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.893151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015866c-8d6e-45cf-a553-7ec25a69325a None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.894632 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 345/702] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:30.899802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:30.900089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:30.900369 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:30.917100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:30.918320 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:30.957897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:30.974431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6365a-f789-4e66-8c69-ce94b58c53c3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.000965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.002969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 346/703] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:31.016837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.017528 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.018423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.018718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.019455 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] RBAC: Adding query filter params (type=network) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:31.019761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.021185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.026680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 358/704] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:31.027741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.036567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.144969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9fe7a-8391-43e9-8e38-d5d4d8af278b None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.180910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.181717 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.181996 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.182263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.182967 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.184404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd66c-c82b-40ec-adec-388cb31da65f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.184528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:31.197671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:31.198653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:31.199611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:31.204050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 347/705] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:31.204906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.232351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.233632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.234371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.235373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.237184 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] RBAC: Adding query filter params (interface=public, service_id=5ce3a7475eec48fe92a169d4de392688, region_id=RegionOne) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:31.237971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.240273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.243307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.254326 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 359/706] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/endpoints?service_id=5ce3a7475eec48fe92a169d4de392688&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:31.256335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.321844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f2c9f-e261-4946-aaf3-b063c30c0b18 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.326350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.361489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.362176 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.362464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.362778 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.363651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:31.363964 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.365319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.375348 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 348/707] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:31.376771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.386993 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724d52-2e2b-4d48-8c09-cd7c218eaca1 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.425888 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.426933 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.427485 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.428082 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.429060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.430691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad74c1-d4b7-4c98-afed-329f2b157dd1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.442828 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 360/708] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/services => generated 1002 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:31.481962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.485125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546fb2c-99ec-4fc4-ad2c-a1d963fb2ab9 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.499167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e184-261a-4354-9f53-c4524cf1c632 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.499798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e184-261a-4354-9f53-c4524cf1c632 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.500603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2e184-261a-4354-9f53-c4524cf1c632 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.503161 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 361/709] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:31.510353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.511374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.512147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.525698 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.526466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.526854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.527199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.527984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:31.528358 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.530408 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.535666 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 349/710] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:31.540415 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:31.541261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.541953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:31.632594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 362/711] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:31.657595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.659204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba5f16-d677-4a2b-b116-fa1afc7df2eb None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.707525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.709133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.709632 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.710133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.711762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] RBAC: Adding query filter params (interface=public, service_id=025dce9c58364140b715e3a6c13d8508, region_id=RegionOne) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:31.712642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.715156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.715931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.726935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 350/712] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/endpoints?service_id=025dce9c58364140b715e3a6c13d8508&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:31.731947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.774617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:31.787253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed09b-e971-41b0-902d-5134c507b2a1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.836670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.837634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.837992 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.838346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.853467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:02:31.863980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:31.865328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:02:31.866147 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:31.870793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 363/713] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:31.872192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:31.880526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf0df6-d3cf-45f0-8c9d-f4506fe4797c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:31.924864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:31.925607 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:31.925788 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:31.926069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:31.926804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:31.928181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:31.936075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 351/714] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/services => generated 1002 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:32.006004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95936a-2b0f-4377-b900-50f7cad39dd5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.014275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:32.046534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.047329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.047648 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.047947 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.048725 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:32.049120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:32.050640 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:32.065680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 364/715] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:32.067858 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.171625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:32.181350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e484-25c1-4491-b398-1efb7c3613a1 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.218454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.219284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.219617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.219901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.231545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:32.232996 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:32.251528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:32.253007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:32.253872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:32.253872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:32.253872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:32.253872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:32.257554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 352/716] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:32.259412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.365680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c7db-1d6d-478a-ab66-178a45d9e051 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.410642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.411405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.411698 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.411976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.412708 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:32.413019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:32.414405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:32.432140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 365/717] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:32.433610 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.539043 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14583d-3650-4eb8-9cc2-7f47b9dbf4c7 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.574696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.575535 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.575826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.576167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.585074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:32.586609 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-d83d6ed2-46f8-4d6a-8e9b-9e92bc973015 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:32.602587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:32.603606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 10:02:32.605564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:32.608757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 353/718] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:32.610209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.643667 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:32.718536 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438696b1-a021-4357-ba1f-2b3b42282af8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.754651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62c91-dd42-4447-95b3-e34ca4bb8b59 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.754976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62c91-dd42-4447-95b3-e34ca4bb8b59 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.755260 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62c91-dd42-4447-95b3-e34ca4bb8b59 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.755363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.755958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.756247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.756525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.756879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 354/719] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:32.757439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:32.757811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:32.759301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:32.761630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.761917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.762200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:32.768453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:32.782802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 366/720] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:32.786038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:32.787269 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:32.787684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.866832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 355/721] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:32.881987 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:32.893545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:32.900819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d060a3-247e-45e5-979e-e20c5028831f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:32.943178 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:32.943860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:32.944171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:32.944438 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.013013 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71ef9-02ac-4f9f-a28e-e759ab01fdd5 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.017534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.019164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.059009 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.060042 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.060970 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.061417 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.062373 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.065276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.067515 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:33.082751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:33.083922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 10:02:33.084975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:33.092794 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 356/722] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:33.093495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.120710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.143346 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 367/723] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:32 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:02:33.146006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.226108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f152-2a19-4f00-8a35-1dd95f0853b1 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.261865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.262545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.262883 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.263220 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.263892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] RBAC: Adding query filter params (name=image) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:33.264203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.265630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.274798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 357/724] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:33.278045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.284612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c801b6-d76d-4695-8803-49b5f45e2bd0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.322352 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.323325 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.323662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.323953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.336517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.338150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.355901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:33.358482 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:33.359526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:33.360522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:33.360522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:33.360522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:33.360522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:33.365677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 368/725] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:33.367819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.414696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ada7b-f436-4a06-a78c-a974a83bf0aa None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.422833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.452806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.453352 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.453641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.453922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.454635 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] RBAC: Adding query filter params (type=image) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:33.454979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.456974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.461999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 358/726] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:33.467567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.502823 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5796d-a70e-4dff-9024-6ce78c3418a2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.541474 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.542091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.542378 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.542668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.543530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:33.543925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.545413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.562920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 369/727] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:33.564043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.594610 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d2a67-f947-4a8a-ae62-50724c3bbb63 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.630911 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.642772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.643924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.644410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.645095 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.647032 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.648587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.677503 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 359/728] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:02:33.681041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:33.686796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f72814-31b5-4175-a7b9-857b41853b02 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.737433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.738608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.739069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.739581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.747954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.749742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-22ad070a-a774-4bd5-afd9-b67cf9064185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:33.766427 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:33.767660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:33.769289 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:33.771551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 370/729] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:33.779884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.850399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf7b0e-5c03-47aa-9139-13ee51797f47 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.850677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf7b0e-5c03-47aa-9139-13ee51797f47 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.850990 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf7b0e-5c03-47aa-9139-13ee51797f47 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.852643 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 371/730] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:33.858065 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.858351 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.858637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.876878 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:33.878164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:33.910371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659db97-20db-4fae-ac7d-0fdbec11ff1b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:33.961463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:33.962129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:33.962414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:33.962757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:33.963520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:33.963833 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:33.965275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:33.967704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 372/731] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:33 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:33.984977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 360/732] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:33.987165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:33.993304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.048699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.105207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.112708 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee84-782c-49a0-b7a5-c047d46895d4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.127401 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc85742-b45d-44a7-a7f6-d3c2d971d085 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.152657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.153660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.154050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.154431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] PATH_INFO: `/v3/services/network` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.155285 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.156969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:34.171092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:34.172412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 10:02:34.173649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:34.178879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 361/733] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:34.187384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.190450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.191381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.191848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.192278 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.194580 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=b2080c582ab448d587b35d6a100cad12) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:34.195130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.196803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d10f4-1733-44a0-9946-d7d51d9de965 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.211873 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 373/734] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:02:33 2022] GET /identity/v3/role_assignments?user.id=b2080c582ab448d587b35d6a100cad12&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:34.310805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6979c-ceb2-4afe-918d-4c4595e5aa03 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.318571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f5e7-dcad-4fdb-a732-7a4457e508c9 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.318913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f5e7-dcad-4fdb-a732-7a4457e508c9 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.319198 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9f5e7-dcad-4fdb-a732-7a4457e508c9 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.319355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.320860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 374/735] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:34.326503 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.326833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.327108 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.350234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:34.352305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:34.355011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.355800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.356027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.356302 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.357016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] RBAC: Adding query filter params (name=network) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:34.357321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.358850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.365252 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 362/736] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:34.371957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.452455 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 375/737] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:34 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:34.478579 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.501728 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddb7a3-f40a-4e54-b928-67670827e14f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.552055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.552722 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.553000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.553273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.553997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] RBAC: Adding query filter params (type=network) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:34.554306 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.555738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.561204 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 363/738] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:34.567064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.569959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.599301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbca9b4-4b34-4b49-85ee-518fe16459f6 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.604067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.644810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.647199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.647701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.648205 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.649201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.650833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:34.667362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:34.668302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 10:02:34.669120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:34.672960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 376/739] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 12 10:02:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:34.679305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.684069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520df751-c762-4639-b2c6-57847f2343cc None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.722645 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.723576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.724034 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.724779 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.725968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.727761 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.752257 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 364/740] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:02:34.804721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524e727-283a-423c-8928-9431cabed6bb None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:34.852472 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:34.853154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:34.853443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:34.853731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:34.854465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:34.854813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:34.856273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:34.862577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 377/741] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:34.868177 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:34.975660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:34.987582 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9220075-1613-4f5d-b178-f2d5ffe93008 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:35.026298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:35.026998 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:35.027279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:35.027550 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:35.028253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:35.028555 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:35.029909 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb05456-701f-4223-856a-573063b18dd0 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:35.035840 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 365/742] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 12 10:02:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:35.041192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:35.044418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:35.146269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a498-82a2-4547-b165-6b45424c48d5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:35.180192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:35.180838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:35.181120 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:35.181396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:35.182140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:35.183804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6ae9-7b4d-4798-9552-6076ecdd0508 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:35.212011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 378/743] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:36.072020 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1030b5-8e01-4b4d-859b-ab4d576728fa None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.072542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1030b5-8e01-4b4d-859b-ab4d576728fa None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.072621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1030b5-8e01-4b4d-859b-ab4d576728fa None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.073978 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 366/744] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:36.079012 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.079416 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.079608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.097097 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:36.098272 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:36.151870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:36.172571 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 379/745] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:36.196706 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1030b5-8e01-4b4d-859b-ab4d576728fa None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:36.302092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1030b5-8e01-4b4d-859b-ab4d576728fa None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:36.335894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:36.336466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.336751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.337026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.362919 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:36.414928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:36.416391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056910fd-f8fd-46a4-b816-61b48e078f0b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:36.525774 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 367/746] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:02:36 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:02:36.527035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:36.624784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084fd59-d0b4-4d4b-ae0a-1d3ea84402fa None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:36.634246 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78643-4a3d-4a34-95f9-49f3bd8973e8 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.634617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78643-4a3d-4a34-95f9-49f3bd8973e8 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.635000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78643-4a3d-4a34-95f9-49f3bd8973e8 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.636537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 368/747] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:36.641641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.641912 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.642113 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.659198 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:36.660384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:36.661893 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:36.662686 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.662987 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.663263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.673896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:36.676559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:02:36.695010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:36.695911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:36.696777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:02:36.696777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:02:36.696777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:02:36.696777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:36.701024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 380/748] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:36.701810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:36.713375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:36.732761 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 369/749] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:36.739907 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:36.757015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:36.813381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c01a-8000-4813-a2db-167c71ad8e63 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:36.853070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:36.853733 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.854018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.854292 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.855051 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:36.855361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:36.856456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dd0cf-3f1e-432c-a099-adf40fc88210 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:36.856762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:36.877753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 381/750] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:36.903275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:36.904118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:36.904405 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:36.904688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:36.905363 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:36.906843 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:36.920511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:36.921520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:36.922434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 370/751] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 12 10:02:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:36.928593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:37.036497 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:37.044478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d926b-b44c-46f1-bdde-dc179d11c330 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:37.080901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:37.081670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.081860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.082146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.082898 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:37.083209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:37.084594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b42ee-43ad-44be-a723-646a8c6a58cf None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:37.090247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 382/752] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:37.095887 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:37.151784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:37.206365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce345978-db63-4799-9454-0635c93d5057 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:37.241003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:37.241670 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.241956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.242237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.242985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:37.243302 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:37.244673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ddb04-af93-4089-894f-62e7aeb57da1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:37.249072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 371/753] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:37.473942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b633-f965-4dcf-bdc2-d59c460c29db None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.474159 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b633-f965-4dcf-bdc2-d59c460c29db None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.474443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b633-f965-4dcf-bdc2-d59c460c29db None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.475871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 383/754] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:37.481091 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.481385 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.481666 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.499501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:37.500964 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:37.565395 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 372/755] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:37 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:37.588301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b633-f965-4dcf-bdc2-d59c460c29db None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:37.688793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b633-f965-4dcf-bdc2-d59c460c29db None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:37.722477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:37.723312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.723596 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.723874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.724581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:37.725916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:37.737801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:37.738801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:37.739618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 384/756] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:37.744854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:37.788498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:37.846695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2529cf-3a44-4115-a419-20aa01a834a0 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:37.879692 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:37.880351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:37.880633 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:37.880907 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:37.881614 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:37.881929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:37.883324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc70a2-5b8b-4cc5-86c1-b05e573405d1 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:37.888202 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 373/757] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:37.894094 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:37.919839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:38.004308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc129ce-5e6f-4d29-bf1a-983b4a278472 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:38.037311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:38.037970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:38.038262 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:38.038544 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:38.039285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:38.039601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:38.041002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fafcef-0d26-4dc8-8a60-48e477ac5a33 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:38.045680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 385/758] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:39.495208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2e79-b76d-43df-b732-09d3529baa07 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:39.495763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2e79-b76d-43df-b732-09d3529baa07 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:39.495763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2e79-b76d-43df-b732-09d3529baa07 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:39.497118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 374/759] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:39.503167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f408-4968-4439-a3e3-406ce04b6d3c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:39.503566 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f408-4968-4439-a3e3-406ce04b6d3c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:39.503732 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432f408-4968-4439-a3e3-406ce04b6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:39.520305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a432f408-4968-4439-a3e3-406ce04b6d3c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:39.521515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a432f408-4968-4439-a3e3-406ce04b6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:39.588305 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 386/760] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:39.611834 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2e79-b76d-43df-b732-09d3529baa07 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:39.710920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2e79-b76d-43df-b732-09d3529baa07 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:39.718055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:39.745488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:39.746147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:39.746431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:39.746724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:39.747465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:39.748830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc02a7-026f-41ae-abe4-f6054ae01193 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:39.763513 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 375/761] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:39 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:02:40.269366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3b55-217d-4c6f-b6fa-f57b46a42989 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:40.269653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3b55-217d-4c6f-b6fa-f57b46a42989 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:40.269933 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3b55-217d-4c6f-b6fa-f57b46a42989 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:40.271350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 387/762] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:40.276376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd532c4-84dc-4d75-9c3e-a32f83b99720 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:40.276666 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd532c4-84dc-4d75-9c3e-a32f83b99720 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:40.276946 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd532c4-84dc-4d75-9c3e-a32f83b99720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:40.293711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6dd532c4-84dc-4d75-9c3e-a32f83b99720 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:40.294906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6dd532c4-84dc-4d75-9c3e-a32f83b99720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:40.364680 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 376/763] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:40 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:40.389154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3b55-217d-4c6f-b6fa-f57b46a42989 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:40.408101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:40.491587 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3b55-217d-4c6f-b6fa-f57b46a42989 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:40.526181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:40.526788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:40.527060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:40.527335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:40.528063 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:40.529433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba0048-96af-4ce9-979b-9331c89af865 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:40.542883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 388/764] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:40 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:42.014048 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76601-5879-4e63-b342-007f2613a0a6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.014579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76601-5879-4e63-b342-007f2613a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.014579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76601-5879-4e63-b342-007f2613a0a6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.016003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 377/765] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:42.021285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.021691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.021840 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.039350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:42.040510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:42.112603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 389/766] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:42.136321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76601-5879-4e63-b342-007f2613a0a6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.225878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:42.236842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76601-5879-4e63-b342-007f2613a0a6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:42.271574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:42.272304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.272590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.272872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.273526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:42.274934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:42.286865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:42.287972 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:42.289244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 378/767] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:42.293919 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.297109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:42.396016 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b86a-9ad7-42c1-84c0-ae2b83c91dea None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:42.430568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:42.431264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.431554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.431836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.432550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:42.432862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:42.434241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:42.438925 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 390/768] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:42.445219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.542672 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d252-b146-486c-9e8e-ce2c71c4c2ba None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:42.575278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:42.575941 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.576229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.576508 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.577213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:42.577526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:42.578924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:42.583737 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 379/769] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:42.589674 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.659604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:42.692404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87c38d-7136-44ab-b2e7-2ce40b8a3bca None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:42.725926 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:42.726579 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.726902 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.727182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.727978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] RBAC: Adding query filter params (interface=public, service_id=2a2d054fd8454644a2012363490485b3, region_id=RegionOne) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:42.728296 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:42.729670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37de48-016d-4ae8-8cbe-3d7ba8bae2fd None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:42.734579 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 391/770] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/endpoints?service_id=2a2d054fd8454644a2012363490485b3&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:42.740224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.763587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:42.765995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38a8f-6c88-4729-be05-9867b5c9b023 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.766367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38a8f-6c88-4729-be05-9867b5c9b023 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.766666 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb38a8f-6c88-4729-be05-9867b5c9b023 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.768602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 392/771] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:02:42.773371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.773660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.773941 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.790110 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:42.791320 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:42.841336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081fe73-b85b-4898-97dc-3e16277cf5e8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:42.856508 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 393/772] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:42.875170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:42.875841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:42.876128 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:42.876407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:42.877166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:42.878534 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:42.880847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:42.890407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 380/773] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:42.948251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:42.990201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aed65-c79b-434a-b700-c12a442a589c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:43.026304 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:43.027139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:43.027422 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:43.027698 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:43.028363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:43.029759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:43.042384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:43.043864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:43.044731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 394/774] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:02:43.050380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:43.136263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:43.151999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20842-f40b-4199-8e67-058b097afb4b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:43.184417 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:43.185067 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:43.185345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:43.185618 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:43.186315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:43.186622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:43.188139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:43.192824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 381/775] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:43.198727 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:43.298621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879534-1fd1-4a73-960f-3c482f5cbc88 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:43.324060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:43.333602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:43.334265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:43.334548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:43.334854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:43.335561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:43.335868 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:43.337241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:43.341943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 395/776] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:43.347895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:43.448123 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c8667-b584-4e60-a352-562e8418e064 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:43.481844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:43.482491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:43.482827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:43.483094 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:43.483878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] RBAC: Adding query filter params (interface=public, service_id=27a6f9218efc43449f2d916524aca3f0, region_id=RegionOne) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:43.484191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:43.485558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f91a28-78a5-4fa9-941b-a826643ec06e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:43.490649 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 382/777] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:43 2022] GET /identity/v3/endpoints?service_id=27a6f9218efc43449f2d916524aca3f0&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:43.496172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:43.600262 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9625100-df09-40f7-b1c3-defe9272c7a0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:43.634439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:43.635142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:43.635431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:43.635712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:43.636403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:43.638616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246df00f-df3c-42f0-8cb7-4d5ba9f43b7f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:43.645887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 396/778] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:43 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:45.110310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417c49-a57f-4031-b1de-0da50d46fcae None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.110891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417c49-a57f-4031-b1de-0da50d46fcae None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.110978 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417c49-a57f-4031-b1de-0da50d46fcae None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.112380 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 383/779] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:45.117646 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.118048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.118206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.134830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:45.135984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:45.183279 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:45.200593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 397/780] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:45.225931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca417c49-a57f-4031-b1de-0da50d46fcae None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:45.240795 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:45.325251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca417c49-a57f-4031-b1de-0da50d46fcae None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:45.357684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:45.358488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.358813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.359087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.359739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:45.361634 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:45.373789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:45.375125 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:45.376390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 384/781] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 12 10:02:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:45.381133 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:45.480326 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870786-2cdd-4214-9243-6d87fdd5d3dc None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:45.514547 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:45.515251 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.515529 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.516508 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:45.516813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:45.518181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:45.522911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 398/782] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:45.528523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:45.602741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:45.626224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283e86-6cc9-49fa-b4c7-1544c87be926 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:45.658763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:45.659425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.659708 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.659991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.660694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:45.661006 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:45.662374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc0bc-e59b-4fef-b948-d26107fdea23 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:45.667146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 385/783] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 12 10:02:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:45.672776 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:45.725153 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:45.778461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f947814-f74f-4995-9bc7-21e49f8a85f2 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:45.812196 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:45.812978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.813264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.813543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.814889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:45.816239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e590-06d5-46e0-8997-cd30e519ee71 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:45.834659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 399/784] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:02:45.870269 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857da2-0904-4ec7-961c-01f04f37fa5e None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.870564 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857da2-0904-4ec7-961c-01f04f37fa5e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.870882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857da2-0904-4ec7-961c-01f04f37fa5e None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.872298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 386/785] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:45.879108 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:45.879327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:45.879616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:45.897581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:45.898858 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:45.976045 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 400/786] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:46.002480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857da2-0904-4ec7-961c-01f04f37fa5e None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:46.119467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857da2-0904-4ec7-961c-01f04f37fa5e None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:46.152575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:46.153296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:46.153578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:46.153850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:46.154492 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:46.155896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:46.167431 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:46.168596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:46.169434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 387/787] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:46.175067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:46.204630 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:46.275859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9c940-6f80-4b8a-981c-c939bb8447ee None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:46.309593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:46.310246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:46.310529 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:46.310841 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:46.311554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:46.311866 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:46.313246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:46.318367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 401/788] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:46.323959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:46.327749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:46.427977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9785b-2873-4f1d-b33b-2f96b3d8b0f8 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:46.460288 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:46.460940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:46.461228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:46.461511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:46.462216 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:46.462526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:46.463923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539906ca-fa9d-4cdf-83c6-9e3283f2aa81 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:46.468628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 388/789] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 12 10:02:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:46.474797 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:46.565741 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:46.572584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fabc-31cd-4f76-ae27-63fa776d1168 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:46.605755 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:46.606404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:46.606687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:46.606991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:46.607738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:46.609113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa1f4-4913-4da4-b2c4-408c52d0ef19 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:46.627719 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 402/790] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:48.091028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b3c6-01d9-4357-8a7e-979e6863bb8f None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.091591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b3c6-01d9-4357-8a7e-979e6863bb8f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.091591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1b3c6-01d9-4357-8a7e-979e6863bb8f None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.092966 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 389/791] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:48.098548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.098989 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.099169 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.116405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:48.117583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:48.187822 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 403/792] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:48.211604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b3c6-01d9-4357-8a7e-979e6863bb8f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:48.277721 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:48.312520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1b3c6-01d9-4357-8a7e-979e6863bb8f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:48.345034 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:48.345746 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.346026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.346300 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.346977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:48.348333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:48.359757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:48.360709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:48.362028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 390/793] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:48.367453 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:48.448791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:48.472522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75275689-e283-4f6c-a071-0ee4bb233ea9 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:48.506377 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:48.507090 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.507374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.507652 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.508360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:48.508695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:48.510067 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d986b-be98-4613-984f-16f505788dd6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:48.515004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 404/794] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:48.520459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:48.618571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5b0b-2067-4009-99a4-b66aeee3f205 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:48.646862 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:48.652138 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:48.652801 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.653089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.653371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.654081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:48.654394 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:48.655804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be01ac-d4fb-4215-b073-d8eacea670e9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:48.660808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 391/795] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:48.864261 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d367-80ea-4f5b-a188-bad653a676d8 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.864590 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d367-80ea-4f5b-a188-bad653a676d8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.864829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71d367-80ea-4f5b-a188-bad653a676d8 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.866333 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 405/796] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:48.871292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:48.871606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:48.871956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:48.888685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:48.889874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:48.958016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 392/797] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:48.982985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71d367-80ea-4f5b-a188-bad653a676d8 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:49.087418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71d367-80ea-4f5b-a188-bad653a676d8 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:49.121168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:49.121901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:49.122119 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:49.122402 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:49.123132 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:49.124574 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:49.126198 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING keystone.server.flask.common [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 10:02:49.135997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:49.144181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.sql.core [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 10:02:49.144181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 10:02:49.144181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [parameters: {'id': 'e17eefde697e48329978c2207c618b57', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 10:02:49.144181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e17eefde697e48329978c2207c618b57.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e17eefde697e48329978c2207c618b57. Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application conn.query(q) Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 10:02:49.161299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result.read() Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 10:02:49.162307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application next(self.gen) Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application yield resource Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application next(self.gen) Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise self.value Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application session.commit() Jul 12 10:02:49.163498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.session.flush() Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application compat.raise_( Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 10:02:49.165405 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 10:02:49.167371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application conn.query(q) Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result.read() Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 10:02:49.169046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [parameters: {'id': 'e17eefde697e48329978c2207c618b57', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:49.170126 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:49.171217 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e17eefde697e48329978c2207c618b57. Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:49.172299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 406/798] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jul 12 10:02:48 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:49.174029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:49.270936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55be77-e132-4ad2-8441-fea1bf4ce1af None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:49.297744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:49.306634 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:49.307565 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:49.307846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:49.308117 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:49.315218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:49.316640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-ebf8886d-19f8-4bcd-9bdf-d5a9f38e9fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:02:49.330683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:49.331575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:49.332435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 393/799] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:49.337868 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:49.444064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564cdf-b1b4-487d-82ef-8c14b0ef41f4 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:49.479816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:49.480477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:49.480763 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:49.481042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:49.481799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:49.482112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:49.483794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e3a5-c6f1-40f7-816c-422e2e010f60 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:49.504033 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 407/800] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:50.876234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11cbe-719e-4ffa-a54d-0c5b249d4aa7 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:50.877315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11cbe-719e-4ffa-a54d-0c5b249d4aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:50.877315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11cbe-719e-4ffa-a54d-0c5b249d4aa7 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:50.878691 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 394/801] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:50.883995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e3fb-8773-4c19-a6ef-51742c777d31 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:50.884434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e3fb-8773-4c19-a6ef-51742c777d31 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:50.884536 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e3fb-8773-4c19-a6ef-51742c777d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:50.901835 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-6546e3fb-8773-4c19-a6ef-51742c777d31 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:50.903342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-6546e3fb-8773-4c19-a6ef-51742c777d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:50.951206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:50.968311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 408/802] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:50.992920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11cbe-719e-4ffa-a54d-0c5b249d4aa7 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:51.091688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11cbe-719e-4ffa-a54d-0c5b249d4aa7 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:51.125245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:51.125900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:51.126180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:51.126502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:51.127241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:51.128602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1fd4-1a10-4a5b-8c6e-ce93137c2fc7 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:51.141404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 395/803] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:02:50 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:02:51.762362 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fba39-9a3e-44ae-94fa-ae2f06a03201 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:51.762678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fba39-9a3e-44ae-94fa-ae2f06a03201 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:51.762994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fba39-9a3e-44ae-94fa-ae2f06a03201 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:51.764379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 409/804] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:51.770263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:51.770556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:51.770867 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:51.790821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:51.791988 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:51.833635 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:51.864544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 396/805] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:51 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 10:02:51.890902 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fba39-9a3e-44ae-94fa-ae2f06a03201 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:51.988162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fba39-9a3e-44ae-94fa-ae2f06a03201 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:52.020964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:52.021565 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:52.021844 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:52.022115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:52.022830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:52.024257 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:52.036833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.sql.core [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 10:02:52.036833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 10:02:52.036833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [parameters: {'user_id': '5a84e96095d24c91ac0d460a108e9215', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 10:02:52.036833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87401) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application conn.query(q) Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result.read() Jul 12 10:02:52.044259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 10:02:52.045209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application next(self.gen) Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application yield resource Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application next(self.gen) Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise self.value Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application session.commit() Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 10:02:52.046215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.session.flush() Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application compat.raise_( Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 10:02:52.047142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 10:02:52.048010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application conn.query(q) Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application result.read() Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 10:02:52.049367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [parameters: {'user_id': '5a84e96095d24c91ac0d460a108e9215', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:52.050215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 10:02:52.051332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:52.052619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 410/806] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 12 10:02:51 2022] POST /identity/v3/users => generated 160 bytes in 155 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:52.053152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:52.150237 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c161-f7eb-47f8-9079-b56f63c9cd56 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:52.188027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:52.188822 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:52.189163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:52.189952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:52.196958 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:52.198482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-488b9507-1f8d-4ebb-9475-f1d943c1ed76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:02:52.212798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:52.213901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:52.214895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 397/807] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:02:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:52.219979 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:52.270918 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:52.330258 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901df7-3ed2-4480-80a0-258cbcdbfa02 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:52.364131 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:52.364790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:52.365072 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:52.365347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:52.366141 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:52.366446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:52.368112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423782-3a01-4f68-ba5f-99d1ea981991 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:52.406260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 411/808] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 12 10:02:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:53.379492 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aa68-2896-43a3-8a43-b8ebd8c8c1cc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:53.380051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aa68-2896-43a3-8a43-b8ebd8c8c1cc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:53.380156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226aa68-2896-43a3-8a43-b8ebd8c8c1cc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:53.381458 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 398/809] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:53.386691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:53.387116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:53.387291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:53.404421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:53.405929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:53.471475 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 412/810] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:53 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:53.495223 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226aa68-2896-43a3-8a43-b8ebd8c8c1cc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:53.525809 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:53.593832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226aa68-2896-43a3-8a43-b8ebd8c8c1cc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:53.626382 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:53.627773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:53.628060 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:53.628336 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:53.628980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:53.630398 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:53.641773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:53.642900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:02:53.643754 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 399/811] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:53.648824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:53.681889 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:53.744049 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a73167-5eac-4f71-b211-9c27e7e25073 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:53.776962 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:53.777610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:53.777892 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:53.778168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:53.778904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:53.779215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:53.780591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:53.785800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 413/812] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:53.791525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:53.882899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:53.888835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d4885-5713-43c2-8cc9-e5745486a9f6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:53.924513 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:53.925169 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:53.925454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:53.925733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:53.926439 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:53.926777 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:53.928147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:53.932900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 400/813] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:53.938871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:54.030804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:54.034240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bdf5e-dbfa-4616-a4ae-98b877976324 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:54.068141 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:54.068794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:54.069082 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:54.069364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:54.070152 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] RBAC: Adding query filter params (interface=public, service_id=7b6ed48491674722ab189ee8c4f0d7de, region_id=RegionOne) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:54.070470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:54.071906 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e596-76db-41de-9596-b642079d9dcf None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:54.076828 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 414/814] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:02:53 2022] GET /identity/v3/endpoints?service_id=7b6ed48491674722ab189ee8c4f0d7de&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:54.082908 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:54.180264 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce8888-99a8-4714-9cb3-3ed2be5f04cb None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:54.212148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:54.212796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:54.213079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:54.213355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:54.214035 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:54.215411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4a25-70d4-4e17-9ed8-0d45a01eae3a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:54.221451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 401/815] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:02:54 2022] GET /identity/v3/services => generated 1728 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:02:56.406268 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d343ef-1d45-4e43-98be-b669392c0523 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:56.406759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d343ef-1d45-4e43-98be-b669392c0523 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:56.406855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d343ef-1d45-4e43-98be-b669392c0523 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:56.408225 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 415/816] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:02:56.413674 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:56.414071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:56.414232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:56.430382 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:02:56.431581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:02:56.448108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:56.495375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 402/817] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:02:56 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:02:56.519822 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d343ef-1d45-4e43-98be-b669392c0523 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:56.616841 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d343ef-1d45-4e43-98be-b669392c0523 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:56.650072 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:56.650811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:56.651095 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:56.651370 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:56.652018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:56.653385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:02:56.664876 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:02:56.665984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:02:56.666890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 416/818] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:02:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:02:56.672174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:56.768701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158a12-f334-4e35-8f56-5420a86189ce None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:56.802073 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:56.802745 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:56.803036 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:56.803313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:56.804015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:56.804326 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:56.805685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:56.810349 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 403/819] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:02:56.816626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:56.844847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:56.914424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8589-0cb4-4e4d-b26c-15b67de2bd88 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:56.946873 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:56.947512 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:56.947798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:56.948077 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:56.948789 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:02:56.949085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:56.950448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2697774-896a-4bd7-8bf9-293698896a95 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:56.955702 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 417/820] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 12 10:02:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:02:56.961452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:02:56.979953 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:02:57.058360 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fd44-860f-4bdd-81f4-61e5ac770354 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:02:57.091579 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:02:57.092225 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:02:57.092512 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:02:57.092791 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:02:57.093517 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:02:57.094915 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e83e0d-f8fb-4cb7-8bdd-ab928e04a72c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:02:57.112804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 404/821] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:02:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:03:06.952736 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=54 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:03:07.107984 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:03:57.579592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f6fb-0b0f-4e03-a4a8-37ebdac2715b None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:03:57.580181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f6fb-0b0f-4e03-a4a8-37ebdac2715b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:03:57.580181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f6fb-0b0f-4e03-a4a8-37ebdac2715b None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:03:57.581720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 418/822] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:03:57.587871 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:03:57.588370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:03:57.588456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:03:57.609159 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:03:57.610685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:03:57.709140 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 405/823] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:03:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:03:57.737992 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7f6fb-0b0f-4e03-a4a8-37ebdac2715b None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:03:57.887584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7f6fb-0b0f-4e03-a4a8-37ebdac2715b None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:03:57.938270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:03:57.939079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:03:57.939358 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:03:57.939636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:03:57.957910 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:03:57.961088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:03:57.986623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:03:57.987704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:03:57.989439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:03:57.989439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:03:57.989439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:03:57.989439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:03:57.989439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 419/824] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:03:57.997929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:03:58.121420 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6a4ca-8314-4a62-9814-40ecf293c3ce None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:03:58.158655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:03:58.169790 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:03:58.171104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:03:58.171104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:03:58.171104 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:03:58.172371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:03:58.172663 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:03:58.174121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3f2a6-8329-48cd-88d3-f0e4cc558864 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:03:58.189594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 406/825] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:03:58.196114 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:03:58.260893 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:03:58.320675 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfd381-812c-4c58-b6d9-63c0382cbf6e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:03:58.358265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:03:58.359050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:03:58.359446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:03:58.359774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:03:58.360524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:03:58.362036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd75dfd-09d8-45f4-b673-9e7e90d2ea3e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:03:58.394800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 420/826] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 12 10:03:58 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:04:00.915768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976674a-012b-4a27-87db-f4b327f49d26 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:00.916359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976674a-012b-4a27-87db-f4b327f49d26 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:00.916359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976674a-012b-4a27-87db-f4b327f49d26 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:00.918084 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 407/827] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:00.924026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:00.925373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:00.925373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:00.942975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:00.944314 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:01.022901 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 421/828] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:01.048569 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976674a-012b-4a27-87db-f4b327f49d26 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:01.172590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976674a-012b-4a27-87db-f4b327f49d26 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:01.210947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:01.211792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:01.212165 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:01.212507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:01.224168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:01.233406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:01.234590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:01.235630 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 408/829] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:01.241080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:01.289309 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:01.360550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26aad6-92b2-4ac7-85e9-bf26e8cc49b1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:01.401808 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:01.402480 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:01.402793 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:01.403074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:01.403830 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:01.404139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:01.405517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:01.414789 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 422/830] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:01.420739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:01.474834 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:01.535732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbaa5-6713-45ea-9cb6-207727a71b6e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:01.573746 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:01.574679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:01.575016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:01.575293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:01.588015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:01.589725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:01.610120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:01.611299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:01.612449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:01.612449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:01.612449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:01.612449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:01.612449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 409/831] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:01.617999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:01.734920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:01.738980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2c3a-5723-475a-a0a3-b8647c9ab620 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:01.786615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:01.787316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:01.787903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:01.788053 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:01.788833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:01.789284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:01.790888 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:01.804929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 423/832] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:01.810950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:01.924762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:01.928936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513394a-1eb7-4c92-a6f1-737edd3cf7ef None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:01.967583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:01.968572 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:01.968931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:01.969309 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:01.978195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:01.979675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:01.996773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:01.998238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:01.999589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 410/833] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:02.005372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:02.119074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c06df7-a98f-4a31-b453-70f09a804f46 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:02.158478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:02.159180 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:02.159467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:02.159742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:02.160576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:02.160893 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:02.162461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:02.183813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 424/834] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:02.191402 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:02.300864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a8c7-fe69-4c27-974a-3f9496dc5629 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:02.336377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:02.337157 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:02.337571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:02.337873 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:02.372942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:02.426872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:02.428338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:02.535066 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 411/835] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:04:02 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:04:02.541532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:02.563248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:02.653541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482cb5-9d42-4b87-8878-1fbd5882bff3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:02.692143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:02.692927 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:02.693209 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:02.693486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:02.703936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:02.705385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:02.723833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:02.724952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:02.726207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:02.726207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:02.726207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:02.726207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:02.726207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 425/836] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:02.731291 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:02.793647 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:02.847591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d1f39-a2db-4698-a89b-cf7fa5072e91 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:02.890007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:02.891525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:02.891805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:02.892079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:02.892795 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:02.893097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:02.894500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:02.906857 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 412/837] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:02.912915 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:02.992943 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:03.027751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1ddb4-bb97-4204-b7d2-00358a4754b3 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:03.067566 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:03.068514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:03.068809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:03.069124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:03.076873 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:03.078881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:03.093179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:03.094664 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:03.095578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 426/838] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:03.100810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:03.211692 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52acd2-6390-4739-bc4e-13324c5f6218 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:03.228911 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:03.246421 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afae816-6065-4050-a200-e71002f46056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:03.247109 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae816-6065-4050-a200-e71002f46056 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:03.247393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae816-6065-4050-a200-e71002f46056 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:03.247667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae816-6065-4050-a200-e71002f46056 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:03.248456 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae816-6065-4050-a200-e71002f46056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:03.248766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae816-6065-4050-a200-e71002f46056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:03.250668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae816-6065-4050-a200-e71002f46056 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:03.263261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 413/839] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:03.272960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:03.401739 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996810d-14cf-43da-8a5b-a0906e293d57 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:03.434899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:03.442595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:03.443407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:03.443826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:03.444222 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:03.445214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=0fecde7214c54a369c5235a8122d47a2) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:03.445621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:03.447341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd19265-f493-402d-aed1-eea9d7e579a1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:03.454766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 427/840] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:04:03 2022] GET /identity/v3/role_assignments?user.id=0fecde7214c54a369c5235a8122d47a2&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:05.828897 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06d1a-8d61-44d1-991b-bcc07ed33729 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:05.829453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06d1a-8d61-44d1-991b-bcc07ed33729 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:05.829453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be06d1a-8d61-44d1-991b-bcc07ed33729 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:05.831061 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 414/841] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:05.836376 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:05.836836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:05.836973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:05.854576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:05.855941 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:05.932145 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 428/842] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:05.955741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06d1a-8d61-44d1-991b-bcc07ed33729 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.072098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be06d1a-8d61-44d1-991b-bcc07ed33729 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:06.114287 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:06.115285 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:06.115544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:06.115875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:06.128119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:06.136601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:06.137733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:06.138886 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 415/843] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:06.145037 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.256171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f0b42-4f49-427b-bfb2-f55acd5bb6ac None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:06.285678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:06.299451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:06.300281 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:06.300678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:06.300939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:06.301890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:06.302363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:06.303799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:06.312215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 429/844] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:04:06.317859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.364435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:06.441631 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67373f-7dc0-4a7d-9331-2d10688910a3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:06.482012 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:06.482901 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:06.483206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:06.483488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:06.495391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:06.496875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:06.515802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:06.516885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:06.518206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:06.518206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:06.518206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:06.518206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:06.518206 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 416/845] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:06.523058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.639380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefb4-0197-4d45-9a4c-a23d246559d7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:06.679312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:06.680013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:06.680363 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:06.680711 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:06.681537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:06.681909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:06.683551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:06.695696 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 430/846] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:06.701404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.806631 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:06.817624 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5d428-910a-4ff3-a882-a023a04e26c4 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:06.852572 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:06.853407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:06.853816 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:06.854100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:06.863386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:06.864844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:06.883468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:06.884757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:06.885920 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:06.891148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 417/847] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:06.891996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:06.940731 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:06.999368 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca73c-58e2-4277-8efd-a567560da6d0 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.049545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.050150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.050439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.050936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.051811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:07.052076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.053939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.083263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 431/848] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:04:07.084418 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:07.199211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b75b1-22be-4caa-9b6b-dd18a2bf2d1c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.238839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.239761 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.240121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.240442 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.252060 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.253776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:07.272825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:07.273906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:07.274943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:07.274943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:07.274943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:07.274943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:07.274943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 418/849] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:04:07.280054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:07.392052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fb0dd-96e9-412e-b505-1b5be99248a9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.394674 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:07.427537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.428468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.428831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.429143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.430049 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:07.430450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.432232 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.447577 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 432/850] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:07.453544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:07.456454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:07.568270 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d081a9-c069-401e-957f-c090fa0b37ec None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.603859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.604760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.605039 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.605362 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.613906 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.615718 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:07.633135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:07.634215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:07.635187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 419/851] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:07.640433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:07.754589 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673765-4226-4f20-ae40-14a307db4741 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.794287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.794984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.795286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.795548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.796919 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:07.797238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.798681 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498ea2c-845f-4cc9-bcc1-433d5bfd1bf2 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.811236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 433/852] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:04:07.817354 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:07.883656 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:07.924301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7adf-e570-472d-b311-69f6c26afe68 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:07.960866 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:07.961815 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:07.962099 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:07.962376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/0fecde7214c54a369c5235a8122d47a2/roles/1b713919183e4aaf9570acd2c4b8648e` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:07.976943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=0fecde7214c54a369c5235a8122d47a2, role_id=1b713919183e4aaf9570acd2c4b8648e)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:07.978384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41efcb5-4fce-4285-b9c7-d7b894a61ba9 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:07.992572 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 420/853] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:04:07 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/0fecde7214c54a369c5235a8122d47a2/roles/1b713919183e4aaf9570acd2c4b8648e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:04:10.367243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141fa7-6c1e-4e39-a2bf-ef0437023dae None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:10.367802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141fa7-6c1e-4e39-a2bf-ef0437023dae None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:10.367802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4141fa7-6c1e-4e39-a2bf-ef0437023dae None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:10.369171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 434/854] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:10.376695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:10.377133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:10.377499 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:10.396193 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:10.397739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:10.476910 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 421/855] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:10.505154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4141fa7-6c1e-4e39-a2bf-ef0437023dae None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:10.532824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:10.618100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4141fa7-6c1e-4e39-a2bf-ef0437023dae None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:10.656279 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:10.657086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:10.657371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:10.657648 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:10.669208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:10.678270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:10.679423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:10.680386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 435/856] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 12 10:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:10.687316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:10.734518 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:10.799409 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756c6b-647f-4a8e-930e-9cf3a7d32806 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:10.837111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:10.837815 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:10.838170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:10.838476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:10.839339 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] RBAC: Adding query filter params (name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:10.839689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:10.841199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:10.850940 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 422/857] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 12 10:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:10.857465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:10.953579 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:10.972179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8443-0e36-41c0-ba8c-0854d2e45516 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:11.010517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:11.011502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:11.011770 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:11.012058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:11.024201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:11.025881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:11.046327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:11.047318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:11.048199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:11.048199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:11.048199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:11.048199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:11.048199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 436/858] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:11.054485 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:11.168506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f5b0-1778-4ae1-8a5c-a8d9073a9012 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:11.171769 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:11.204847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:11.205540 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:11.205875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:11.206201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:11.207031 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:11.207342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:11.208872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:11.221569 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 423/859] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:11.228199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:11.334578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d9e91-f1ad-4e4a-9e9e-1357fe77d8ec None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:11.371213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:11.372194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:11.372545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:11.372833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:11.376473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:11.382716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:11.384548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:11.401253 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:11.402269 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:11.403237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 437/860] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:11.409893 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:11.515334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db22d-b8ae-4ec8-b598-c04a67e9cc4a None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:11.551661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:11.552413 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:11.552752 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:11.553072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:11.554120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:11.554435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:11.555954 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:11.580587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 424/861] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:11.581825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:11.691588 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495f9b2-f05b-4b44-9ca7-74adc4de372d None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:11.727235 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:11.727884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:11.728168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:11.728445 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:11.799115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:11.806624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:11.808446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:11.930254 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 438/862] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:04:11 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:04:11.936519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:11.962120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:12.052849 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b09d-f298-400f-8d25-f53b30748e59 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:12.098545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:12.099733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:12.099936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:12.100232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:12.115507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:12.117492 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:12.139414 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:12.141321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:12.142215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:12.142215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:12.142215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:12.142215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:12.142215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 425/863] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 10:04:12.147715 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:12.258859 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:12.266908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c27e-289b-42c1-9d3f-2d509f03f2ae None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:12.307162 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:12.307815 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:12.308099 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:12.308374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:12.309219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:12.309531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:12.310998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:12.324882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 439/864] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:12.330957 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:12.411944 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:12.443002 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4fab6-8dc8-49f9-a8d9-ec1788731f0e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:12.484574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:12.485373 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:12.485653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:12.485928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:12.493636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:12.495917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:12.512334 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:12.513601 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:12.514681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 426/865] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:12.519890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:12.653290 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce57f-0e6b-4eff-b34d-fe2e5eeb45ec None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:12.693656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:12.694358 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:12.694635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:12.694909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:12.695856 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:12.696215 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:12.697913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c987dd3-65e3-4d5a-842d-1457332823f6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:12.711519 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 440/866] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:12.717576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:12.831723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b45f-6294-4434-985c-2b8dbaf1280b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:12.873616 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:12.874599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:12.874959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:12.875238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:12.876070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] RBAC: Adding query filter params (role.id=1b713919183e4aaf9570acd2c4b8648e, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=0fecde7214c54a369c5235a8122d47a2) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:12.876389 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:12.877864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f249c-1e4a-4c9f-826b-a5b00b95ef0d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:12.879888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:12.887670 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 427/867] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:04:12 2022] GET /identity/v3/role_assignments?user.id=0fecde7214c54a369c5235a8122d47a2&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=1b713919183e4aaf9570acd2c4b8648e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:15.209686 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d271-8dc3-4bba-a6c3-a5f0427dbddf None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:15.210366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d271-8dc3-4bba-a6c3-a5f0427dbddf None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:15.210366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d271-8dc3-4bba-a6c3-a5f0427dbddf None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:15.211622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 441/868] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:15.216757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:15.217434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:15.217434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:15.235133 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:15.236337 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:15.309331 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 428/869] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:15.339985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d271-8dc3-4bba-a6c3-a5f0427dbddf None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:15.360343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:15.453063 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d271-8dc3-4bba-a6c3-a5f0427dbddf None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:15.488949 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:15.489688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:15.489948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:15.490223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:15.501040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:15.508604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:15.509510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:15.510581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 442/870] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:15.516323 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:15.619207 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b2374-a4b6-4aaf-afc8-ee6624791873 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:15.646667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:15.655092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:15.656304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:15.656594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:15.656875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:15.657613 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:15.657924 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:15.659318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:15.668895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 429/871] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:15.673661 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:15.765142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:15.795871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83427e5d-600b-4895-8a18-7c7b819b6168 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:15.834190 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:15.835094 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:15.835434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:15.835771 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:15.849797 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:15.851312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:15.870811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:15.872039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:15.873013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:15.873013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:15.873013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:15.873013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:15.873013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 443/872] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:15.880129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:15.988588 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2251-ac71-461e-86b8-f02b9efac16f None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:16.026428 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:16.027053 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:16.027342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:16.027623 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:16.028424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:16.028733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:16.030111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:16.044377 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 430/873] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:16.051481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:16.175066 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0a7a6-458e-49cd-b5bc-bbcd67c421d7 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:16.206543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:16.216316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:16.217203 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:16.217486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:16.217763 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:16.226145 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:16.227754 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:16.244575 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:16.245706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:16.246737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 444/874] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:16.253029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:16.311103 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:16.365850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc136-2430-40f6-9ab2-84a5953e7572 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:16.408578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:16.409274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:16.409560 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:16.409836 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:16.410687 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:16.411029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:16.412469 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:16.431111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 431/875] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:16.437537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:16.544824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e385e-db8f-4957-ab0a-bf624d4fe02e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:16.579914 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:16.580611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:16.580900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:16.581185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:16.642008 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:16.656237 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:16.657734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:16.768598 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 445/876] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:04:16 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:04:16.774516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:16.878275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ca37-b080-4be1-8661-68287dcd0ca2 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:16.887479 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:16.914144 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:16.914963 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:16.915250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:16.915529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:16.925673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:16.927151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:16.945583 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:16.946594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:16.947511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:16.947511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:16.947511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:16.947511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:16.947511 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 432/877] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:16.953098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:17.042880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:17.057407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61d9d2-2fe8-41b9-a0d7-3d6f31daf59c None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:17.095182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:17.095855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:17.096140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:17.096461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:17.097192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:17.097502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:17.098977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:17.112043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 446/878] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:17.118089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:17.218506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732048-2440-4f3f-a7ed-aef6b9a44694 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:17.252101 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:17.252878 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:17.253167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:17.253697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:17.259925 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:17.261363 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:17.275542 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:17.276551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:17.277636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 433/879] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:17.282683 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:17.380559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09452b6-3533-413f-95e5-4668d8f56f20 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:17.414420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:17.415109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:17.415397 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:17.415677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:17.416464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:17.416777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:17.418214 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e97ed2-31eb-4cab-a9ad-e9d680656fd4 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:17.430398 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 447/880] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:17.436522 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:17.458681 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:17.537240 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6fa-d1be-44d0-b147-305db49f4643 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:17.568684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:17.569316 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:17.569597 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:17.569868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:17.570673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=0fecde7214c54a369c5235a8122d47a2) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:17.571012 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:17.572450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c8ab-3c16-4b58-8aa5-1108a4b2a809 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:17.578391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 434/881] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:04:17 2022] GET /identity/v3/role_assignments?user.id=0fecde7214c54a369c5235a8122d47a2&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:19.767004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfedd0-8f28-4c55-8be5-c769630586a3 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:19.767498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfedd0-8f28-4c55-8be5-c769630586a3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:19.767498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfedd0-8f28-4c55-8be5-c769630586a3 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:19.768854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 448/882] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:19.774066 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:19.774499 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:19.774634 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:19.791596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:19.792783 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:19.856868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 435/883] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:19.880527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfedd0-8f28-4c55-8be5-c769630586a3 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:19.891717 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:19.981111 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfedd0-8f28-4c55-8be5-c769630586a3 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.014108 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.015539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.015824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.016099 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.025953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:20.033567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:20.034655 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:20.035543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 449/884] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:20.040693 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.056398 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:20.158002 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c77329-2ad9-402f-b893-1ac31725552f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.190340 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.191028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.191312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.191591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.192324 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:20.192638 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.193992 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:20.201695 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 436/885] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:20.208015 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.272927 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:20.305764 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c1ee8-7d98-47c3-ad5b-9c5716bbc9dc None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.338662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.339463 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.339757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.340034 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.350508 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.351996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:20.369284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:20.370177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:20.371291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:20.371291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:20.371291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:20.371291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:20.371291 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 450/886] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:20.376992 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.450902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:20.472741 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b02b4-69e5-432b-926d-3e0b0be4376d None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.505180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.505823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.506102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.506375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.507114 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:20.507421 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.508771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:20.519938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 437/887] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:20.525481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.621321 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3f517-27fc-438d-bf8e-93a9071c76f8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.640656 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:20.654459 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.655344 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.655638 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.655916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.663115 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.664550 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:20.678834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:20.679916 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:20.681070 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 451/888] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:20.685745 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.782098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e21da-daee-4036-a7cd-4c937fac46af None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.814512 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.815198 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.815487 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.815767 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.816591 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:20.816902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.818318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:20.820793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:20.835266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 438/889] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:20.840880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:20.939061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99413-623d-4de0-9459-0f909a45686a None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:20.971433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:20.972208 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:20.972494 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:20.972776 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:20.983039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:20.985137 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:21.002052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:21.003056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:21.004103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:21.004103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:21.004103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:21.004103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:21.004103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 452/890] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:21.008870 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:21.115500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e8b3b-325d-421a-9907-dc3b5c61212e None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:21.148961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:21.149617 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:21.149905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:21.150182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:21.150926 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:21.151236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:21.152599 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:21.164181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 439/891] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:21.169735 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:21.200478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:21.270158 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958b91-7198-4a76-9203-2c3d04e614e8 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:21.303433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:21.304213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:21.304498 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:21.304778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:21.311441 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:21.312883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:21.326831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:21.328437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:21.329514 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 453/892] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:21.334416 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:21.387633 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:21.433218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c7ac8-2f14-4a59-a471-0aeb943d1441 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:21.465313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:21.465899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:21.466182 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:21.466457 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:21.467332 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:21.467787 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:21.470045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0a8d2-454e-4371-8bd5-9fb2388caa06 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:21.482108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 440/893] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:21.488887 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:21.576586 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:21.585277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb522f0-d338-452d-95bb-0c2a822e35a5 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:21.618232 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:21.619118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:21.619398 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:21.619672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] PATH_INFO: `/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/0fecde7214c54a369c5235a8122d47a2/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:21.621582 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b427b99ec90245c2ac53ed43ce632360, user_id=0fecde7214c54a369c5235a8122d47a2, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:21.623043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492306c9-6d24-44e7-91f1-822bf1f5c2bd None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:21.635264 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 454/894] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 12 10:04:21 2022] PUT /identity/v3/projects/b427b99ec90245c2ac53ed43ce632360/users/0fecde7214c54a369c5235a8122d47a2/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:04:23.848482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3e2e3-9c2e-4148-b644-7f3a09d602d7 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:23.849011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3e2e3-9c2e-4148-b644-7f3a09d602d7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:23.849011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3e2e3-9c2e-4148-b644-7f3a09d602d7 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:23.850383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 441/895] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:23.855436 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:23.855816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:23.856006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:23.872350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:23.873539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:23.939139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 455/896] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:23.964051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3e2e3-9c2e-4148-b644-7f3a09d602d7 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.065827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3e2e3-9c2e-4148-b644-7f3a09d602d7 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.082111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:24.105475 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.106301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.106638 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.107027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.119164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 10:04:24.129217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:24.130135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:24.131134 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 442/897] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 12 10:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:24.136568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.214399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:24.232880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19508-3ce4-4a4d-8abf-4a575b98a920 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.266660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.267345 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.267634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.267922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.268668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:24.268981 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:24.270361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:24.278270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 456/898] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:24.283810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.380696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82baf3-192e-4297-b6ca-28ede280f432 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.412861 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.413646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.413927 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.414201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.424770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:24.426194 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:24.442997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:24.444000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:24.445010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:24.445010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:24.445010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:24.445010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:24.445010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 443/899] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:24.450246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.547659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c15d9-4b59-4f39-9e82-b0fb8d5f6485 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.580117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.580771 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.581058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.581342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.582062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:24.582375 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:24.583780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:24.595649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 457/900] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:24.601884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.629919 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:24.699119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77cea8-c2e6-4126-a2c1-6f483ddd7430 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.730821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.731600 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.731881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.732155 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.739983 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:24.741400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 10:04:24.755903 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:24.757016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:24.758152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 444/901] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:24.763495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:24.767343 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:24.861825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69039c6-0536-4fee-8f12-bdba4adbff7f None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:24.895881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:24.896537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:24.896822 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:24.897101 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:24.897939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:24.898255 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:24.899715 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:24.917040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 458/902] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:24.923111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.006507 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:25.021968 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c34f3f-107b-4ce2-bb7d-25c224740b06 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:25.054916 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:25.055849 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:25.056180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:25.056636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:25.127088 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:25.128527 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:25.207979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:25.223755 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 445/903] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 12 10:04:24 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 10:04:25.229587 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.290361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:25.327327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af33d2-1acf-4f6f-a7ce-344c734234ad None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:25.360965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:25.361736 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:25.362015 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:25.362285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:25.383659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:25.385093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 10:04:25.407557 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:25.408621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:25.409721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 10:04:25.409721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 10:04:25.409721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 10:04:25.409721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:25.409721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 459/904] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:25.414449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.509771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d9e5-4bc5-4eb0-90b9-71140e29931b None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:25.542469 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:25.543092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:25.543379 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:25.543654 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:25.544366 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:25.544674 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:25.546119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:25.556928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 446/905] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 12 10:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:25.563078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.660006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df4d5-a2f6-4362-a16c-f203ca388de6 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:25.673497 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:25.693556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:25.694338 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:25.694624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:25.694935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:25.701505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:25.703495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 10:04:25.716997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:25.718616 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: ERROR keystone.server.flask.application Jul 12 10:04:25.719884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 460/906] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 12 10:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:25.724772 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.770069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:25.820317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b8b9a-b213-49cd-908c-113e9a4cd85c None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:25.852856 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:25.853498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:25.853780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:25.854054 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:25.854860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:25.855171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:25.856580 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c702-f8d3-4457-b4f8-41c19b313812 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:25.868011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 447/907] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 12 10:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:25.874218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:25.973206 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9c45-a3c2-46b0-9ac4-562a38821cc9 None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:26.005348 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:26.005986 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:26.006266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:26.006539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:26.007384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] RBAC: Adding query filter params (role.id=9ebf48ed1d4a47beaf172db42a118091, scope.project.id=b427b99ec90245c2ac53ed43ce632360, user.id=0fecde7214c54a369c5235a8122d47a2) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:26.007693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:26.009112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c362-e3ee-4c47-a95f-94887c5ac489 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:26.015303 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 461/908] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 12 10:04:25 2022] GET /identity/v3/role_assignments?user.id=0fecde7214c54a369c5235a8122d47a2&scope.project.id=b427b99ec90245c2ac53ed43ce632360&role.id=9ebf48ed1d4a47beaf172db42a118091 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:04:28.222559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fb78-2429-45f3-b2f5-373f4347750c None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:28.223111 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fb78-2429-45f3-b2f5-373f4347750c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:28.223231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fb78-2429-45f3-b2f5-373f4347750c None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:28.224588 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 448/909] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:28.229780 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:28.230200 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:28.230334 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:28.247201 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:28.248371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:28.277096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:28.313813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 462/910] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:28.337026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3fb78-2429-45f3-b2f5-373f4347750c None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:28.437188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3fb78-2429-45f3-b2f5-373f4347750c None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:28.445034 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:28.471581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:28.472367 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:28.472701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:28.472932 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:28.473578 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:28.474982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:28.487297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:28.488461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:28.489488 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 449/911] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 12 10:04:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:28.494540 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:28.589900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6507a-e672-4e37-9134-ad38b64ab40c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:28.623360 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:28.624318 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:28.624604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:28.624884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:28.625589 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:28.625900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:28.627451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d2e5d-4a99-49ad-97e7-42639468d8c1 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:28.632104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 463/912] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 12 10:04:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:28.637640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:28.734191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee06ae3-cf09-4648-8e8c-7ceaf9d66ac3 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:28.766776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:28.767423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:28.767709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:28.767986 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] PATH_INFO: `/v3/services` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:28.768687 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] RBAC: Adding query filter params (type=placement) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:28.768997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:28.770351 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f639b-f047-4657-8ed1-41c00b483dfb None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:28.774652 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 450/913] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 12 10:04:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:31.000379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060e431-27bb-4df2-a672-995d0e324af6 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:31.000936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060e431-27bb-4df2-a672-995d0e324af6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:31.000936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060e431-27bb-4df2-a672-995d0e324af6 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:31.002307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 464/914] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:31.007333 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e579-64ea-4cca-8169-8a775c3d4235 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:31.007711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e579-64ea-4cca-8169-8a775c3d4235 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:31.007892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e579-64ea-4cca-8169-8a775c3d4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:31.025152 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-1726e579-64ea-4cca-8169-8a775c3d4235 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:31.026325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-1726e579-64ea-4cca-8169-8a775c3d4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:31.054628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:31.101171 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 451/915] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:31.129549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060e431-27bb-4df2-a672-995d0e324af6 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:31.161928 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:31.231273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060e431-27bb-4df2-a672-995d0e324af6 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:31.274768 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:31.275395 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:31.275678 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:31.275956 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:31.276685 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:31.278064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88424781-7e75-402a-8aaf-ce75065e4bd8 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:31.291591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 465/916] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 12 10:04:31 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:04:33.487295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef954c-215f-47d0-8a34-dcbde6b4aa03 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:33.487825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef954c-215f-47d0-8a34-dcbde6b4aa03 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:33.487825 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef954c-215f-47d0-8a34-dcbde6b4aa03 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:33.489195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 452/917] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:33.494355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:33.494757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:33.494958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:33.512771 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:33.513967 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:33.586756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 466/918] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:33 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:33.611639 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef954c-215f-47d0-8a34-dcbde6b4aa03 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:33.710865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef954c-215f-47d0-8a34-dcbde6b4aa03 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:33.744191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:33.744983 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:33.745271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:33.745550 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:33.746201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:33.747595 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:33.759486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:33.760651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:33.761551 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 453/919] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 12 10:04:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:33.766504 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:33.784636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:33.862594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8c08a-2587-48fd-a8ad-09e4f91b2a3a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:33.895244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:33.895885 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:33.896171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:33.896446 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:33.897142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] RBAC: Adding query filter params (name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:33.897447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:33.898836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:33.903718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 467/920] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 12 10:04:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:33.910500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:33.938093 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:34.008691 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1073-71bb-4d96-be85-4c77970b8982 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:34.042457 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:34.043210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:34.043495 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:34.044228 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:34.045290 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] RBAC: Adding query filter params (interface=public, service_id=94c8049500604047b271a05bc594a71a, region_id=RegionOne) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:34.045663 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:34.047062 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b32bd-57d9-4d44-ae63-036d00e80716 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:34.051977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 454/921] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 12 10:04:33 2022] GET /identity/v3/endpoints?service_id=94c8049500604047b271a05bc594a71a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:34.060335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:34.142283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:34.161399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e94565-ae0b-4da3-aee0-608ce146689e None admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:34.193973 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:34.194628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:34.194941 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:34.195229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:34.195915 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:34.197294 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f4ce6-55fb-4844-8f9f-4aa059f13616 None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:34.204320 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 468/922] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 12 10:04:34 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:04:36.441563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a7a-5476-4cc6-bbbb-7bd4371e512c None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:36.442079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a7a-5476-4cc6-bbbb-7bd4371e512c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:36.442169 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c7a7a-5476-4cc6-bbbb-7bd4371e512c None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:36.443546 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 455/923] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:04:36.448555 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:36.448958 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:36.449142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:36.465545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:04:36.466749 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:04:36.531769 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 469/924] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:04:36 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 10:04:36.555881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7a7a-5476-4cc6-bbbb-7bd4371e512c None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:36.643945 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:36.653250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c7a7a-5476-4cc6-bbbb-7bd4371e512c None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:36.685860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:36.686641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:36.686947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:36.687219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:36.687859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:36.689208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 10:04:36.700665 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 10:04:36.701793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application with Lock( Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self._enter() Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application return self.creator() Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application created_value = creator( Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: ERROR keystone.server.flask.application Jul 12 10:04:36.702991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 456/925] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 12 10:04:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 10:04:36.707707 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:36.781064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:36.803018 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc450c-9e64-4302-ad5e-6ef327e3d49d None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:36.836420 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:36.837055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:36.837335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:36.837607 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] PATH_INFO: `/v3/services` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:36.838302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:04:36.838605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:36.840004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e713-75dd-4fa8-8c6d-28d0d8dbbe9b None admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:36.844897 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 470/926] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 12 10:04:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:04:36.850543 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:04:36.948191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b5788-3bcd-47f4-b06f-a95a4df02fd6 None admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:04:36.979460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:04:36.980092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:04:36.980378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:04:36.980651 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:04:36.981370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:04:36.982735 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c185-60c2-4166-96a9-5a45e809251e None admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:04:37.001526 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 457/927] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 12 10:04:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:04:46.842596 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=30 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:04:46.996365 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:05:34.955369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35246ff-7b6e-4bc9-9587-1d9f26e936e4 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:34.956361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35246ff-7b6e-4bc9-9587-1d9f26e936e4 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:34.956869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35246ff-7b6e-4bc9-9587-1d9f26e936e4 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:34.958760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 471/928] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:34.963938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4a1b-102b-4e45-95ff-fe906683bd4e None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:34.964400 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4a1b-102b-4e45-95ff-fe906683bd4e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:34.964480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4a1b-102b-4e45-95ff-fe906683bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:34.987386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-5efb4a1b-102b-4e45-95ff-fe906683bd4e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:34.989703 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-5efb4a1b-102b-4e45-95ff-fe906683bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:35.074655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 458/929] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:35.134125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305946-a14c-4109-ae65-60bdd24c9152 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:35.134448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305946-a14c-4109-ae65-60bdd24c9152 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:35.134772 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305946-a14c-4109-ae65-60bdd24c9152 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:35.136620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 472/930] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jul 12 10:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:35.146923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8702b2-c664-42e8-a54e-28919dfa69c8 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:35.147616 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8702b2-c664-42e8-a54e-28919dfa69c8 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:35.148079 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8702b2-c664-42e8-a54e-28919dfa69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:35.227375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-3d8702b2-c664-42e8-a54e-28919dfa69c8 None None] MFA Rules not processed for user `f2a50a8a6aeb466fa87b4b8773658f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:35.228585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-3d8702b2-c664-42e8-a54e-28919dfa69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:35.312716 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 459/931] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jul 12 10:05:35 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:35.321512 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305946-a14c-4109-ae65-60bdd24c9152 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:35.333176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305946-a14c-4109-ae65-60bdd24c9152 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:35.336634 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:35.337265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:35.337548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:35.337825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:35.349435 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:35.351384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c13cc-3685-4fca-a65b-bacbc428c240 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:35.362511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 473/932] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:37.861900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141679c-332a-492e-9d9c-f5ec134f1aa6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:37.862451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141679c-332a-492e-9d9c-f5ec134f1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:37.862451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141679c-332a-492e-9d9c-f5ec134f1aa6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:37.863868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 460/933] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:37.868902 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25da46-a1e5-4dc6-a5eb-e2d7208ef60f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:37.869384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25da46-a1e5-4dc6-a5eb-e2d7208ef60f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:37.869542 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25da46-a1e5-4dc6-a5eb-e2d7208ef60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:37.888361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-ed25da46-a1e5-4dc6-a5eb-e2d7208ef60f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:37.889533 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-ed25da46-a1e5-4dc6-a5eb-e2d7208ef60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:37.897230 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 474/934] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:37.936450 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141679c-332a-492e-9d9c-f5ec134f1aa6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:37.947271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141679c-332a-492e-9d9c-f5ec134f1aa6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:37.951304 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:37.951941 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:37.952229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:37.952509 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:37.961269 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:37.962694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1728a0-a5c0-435b-9e5b-39554542bf9c service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:37.973013 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 461/935] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:40.540054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2756-e870-4624-8853-cdbdaed060c7 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:40.540609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2756-e870-4624-8853-cdbdaed060c7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:40.540700 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2756-e870-4624-8853-cdbdaed060c7 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:40.542350 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 475/936] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:40.548619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1711e-9353-4bc7-856f-d216af4b8e79 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:40.549075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1711e-9353-4bc7-856f-d216af4b8e79 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:40.549210 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1711e-9353-4bc7-856f-d216af4b8e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:40.584674 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-89b1711e-9353-4bc7-856f-d216af4b8e79 None None] MFA Rules not processed for user `7ce6150e352c4ed7925d6778a419ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:40.585873 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-89b1711e-9353-4bc7-856f-d216af4b8e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:40.627543 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:05:40.661084 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 462/937] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:40 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:40.699716 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2756-e870-4624-8853-cdbdaed060c7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:40.710882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2756-e870-4624-8853-cdbdaed060c7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:40.714388 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:40.715125 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:40.715474 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:40.716413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:40.725700 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:40.727276 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba80c7-3801-4cfb-8429-757f384f5446 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:40.737078 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 476/938] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:40 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:43.586424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d2-a8a3-4c61-ac01-a789c2456984 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:43.587027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d2-a8a3-4c61-ac01-a789c2456984 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:43.587027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d2-a8a3-4c61-ac01-a789c2456984 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:43.588399 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 463/939] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:43.594128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128fcb-2eed-4c96-ada5-4815b568a5e5 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:43.594515 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128fcb-2eed-4c96-ada5-4815b568a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:43.594692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84128fcb-2eed-4c96-ada5-4815b568a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:43.612195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-84128fcb-2eed-4c96-ada5-4815b568a5e5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:43.613374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-84128fcb-2eed-4c96-ada5-4815b568a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:43.680524 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 477/940] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:43 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:43.720768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615d3d2-a8a3-4c61-ac01-a789c2456984 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:43.731559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615d3d2-a8a3-4c61-ac01-a789c2456984 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:43.735044 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:43.735774 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:43.736120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:43.736462 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:43.745947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:43.747428 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512242a0-fc27-4b04-bf1f-2638d70da304 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:43.757211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 464/941] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:43 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:46.650888 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19552b8-ebc2-4275-9fe6-f73290d2de75 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:46.651421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19552b8-ebc2-4275-9fe6-f73290d2de75 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:46.651421 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19552b8-ebc2-4275-9fe6-f73290d2de75 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:46.652822 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 478/942] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:46.658051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df56aa-8231-4544-8a54-eca4f1a9579e None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:46.658449 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df56aa-8231-4544-8a54-eca4f1a9579e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:46.658605 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df56aa-8231-4544-8a54-eca4f1a9579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:46.678099 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-c2df56aa-8231-4544-8a54-eca4f1a9579e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:46.679311 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-c2df56aa-8231-4544-8a54-eca4f1a9579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:46.687775 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 465/943] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:46.724684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19552b8-ebc2-4275-9fe6-f73290d2de75 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:46.736364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19552b8-ebc2-4275-9fe6-f73290d2de75 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:46.739913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:46.740554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:46.740845 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:46.741135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:46.750465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:46.751991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f1497-0cd8-4df5-a872-a285b26c2cf3 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:46.761532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 479/944] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:49.054812 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923bd67-ba6e-4ded-82fb-748c6bf7ee5d None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:49.055372 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923bd67-ba6e-4ded-82fb-748c6bf7ee5d None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:49.055372 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923bd67-ba6e-4ded-82fb-748c6bf7ee5d None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:49.056683 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 466/945] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:49.063035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e773cf-f403-42e1-b779-9a1ba8f1a07a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:49.063488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e773cf-f403-42e1-b779-9a1ba8f1a07a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:49.063589 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e773cf-f403-42e1-b779-9a1ba8f1a07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:49.080905 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a6e773cf-f403-42e1-b779-9a1ba8f1a07a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:49.082092 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a6e773cf-f403-42e1-b779-9a1ba8f1a07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:49.089824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 480/946] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:49.141719 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408700a-87f6-4a8d-bf01-de7dff1f9173 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:49.142027 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408700a-87f6-4a8d-bf01-de7dff1f9173 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:49.142308 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408700a-87f6-4a8d-bf01-de7dff1f9173 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:49.143736 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 467/947] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jul 12 10:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:49.149755 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5396cf-e106-407c-acd3-0bb306bb8fa8 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:49.150074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5396cf-e106-407c-acd3-0bb306bb8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:49.150354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5396cf-e106-407c-acd3-0bb306bb8fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:49.168144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5e5396cf-e106-407c-acd3-0bb306bb8fa8 None None] MFA Rules not processed for user `f2a50a8a6aeb466fa87b4b8773658f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:49.169848 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5e5396cf-e106-407c-acd3-0bb306bb8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:49.176188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 481/948] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jul 12 10:05:49 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:05:49.185407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408700a-87f6-4a8d-bf01-de7dff1f9173 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:49.195659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408700a-87f6-4a8d-bf01-de7dff1f9173 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:49.199071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:49.199693 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:49.199971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:49.200246 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:49.208838 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:49.210286 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32628f8f-3f4d-47af-8500-79e16c74fa7c service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:49.219421 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 468/949] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:51.713443 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6aa0-5b9b-49fa-8bc4-53f639d67258 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:51.713963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6aa0-5b9b-49fa-8bc4-53f639d67258 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:51.713963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6aa0-5b9b-49fa-8bc4-53f639d67258 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:51.716023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 482/950] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:51.721075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc67d9-e4d3-445e-af8b-ae3fa00eba17 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:51.721474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc67d9-e4d3-445e-af8b-ae3fa00eba17 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:51.721755 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc67d9-e4d3-445e-af8b-ae3fa00eba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:51.739768 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-b8bc67d9-e4d3-445e-af8b-ae3fa00eba17 None None] MFA Rules not processed for user `7ce6150e352c4ed7925d6778a419ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:51.740956 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-b8bc67d9-e4d3-445e-af8b-ae3fa00eba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:51.749278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 469/951] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:51 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:51.791712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f6aa0-5b9b-49fa-8bc4-53f639d67258 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:51.803857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f6aa0-5b9b-49fa-8bc4-53f639d67258 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:51.807371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:51.808012 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:51.808302 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:51.808584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:51.817817 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:51.819316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24202-b11b-4313-8b3c-dc8c963ffa61 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:51.829193 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 483/952] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:51 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:54.452948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8abdb-0a81-4c04-b7f3-8959deba5cbe None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:54.453467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8abdb-0a81-4c04-b7f3-8959deba5cbe None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:54.453467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8abdb-0a81-4c04-b7f3-8959deba5cbe None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:54.454829 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 470/953] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:54.460080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b23d-d4de-4249-9722-5ded91b4e8b3 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:54.460500 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b23d-d4de-4249-9722-5ded91b4e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:54.460803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830b23d-d4de-4249-9722-5ded91b4e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:54.478270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4830b23d-d4de-4249-9722-5ded91b4e8b3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:54.479499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4830b23d-d4de-4249-9722-5ded91b4e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:54.488301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 484/954] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:54.525280 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8abdb-0a81-4c04-b7f3-8959deba5cbe None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:54.536961 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8abdb-0a81-4c04-b7f3-8959deba5cbe None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:54.540537 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:54.541205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:54.541492 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:54.541770 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:54.552282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:54.553747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8986cc-ebf0-4888-b48c-bc181e0a13a6 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:54.563725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 471/955] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:56.839612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9881b0-25c4-4fca-9ee8-ee39bf344c4d None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:56.840654 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9881b0-25c4-4fca-9ee8-ee39bf344c4d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:56.840654 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9881b0-25c4-4fca-9ee8-ee39bf344c4d None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:56.842026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 485/956] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:56.847185 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39bc7-6379-40fe-96ab-4ffc5a7da92b None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:56.847606 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39bc7-6379-40fe-96ab-4ffc5a7da92b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:56.847874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f39bc7-6379-40fe-96ab-4ffc5a7da92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:56.866052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-50f39bc7-6379-40fe-96ab-4ffc5a7da92b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:56.867285 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-50f39bc7-6379-40fe-96ab-4ffc5a7da92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:56.875487 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 472/957] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:56.915938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9881b0-25c4-4fca-9ee8-ee39bf344c4d None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:56.922170 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=68 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:05:56.928624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9881b0-25c4-4fca-9ee8-ee39bf344c4d None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:56.932169 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:56.932794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:56.933082 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:56.933364 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:56.942312 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:56.943785 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad209ef-d1d2-4780-b18a-96e8d00ceded service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:56.953194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 486/958] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:05:59.538575 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305c7f-412a-46bb-8b01-615b224c0d39 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:59.539118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305c7f-412a-46bb-8b01-615b224c0d39 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:59.539208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305c7f-412a-46bb-8b01-615b224c0d39 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:59.540538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 473/959] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:05:59.545736 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd2c6-dc5e-4be5-9872-1decedc1de61 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:59.546173 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd2c6-dc5e-4be5-9872-1decedc1de61 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:59.546299 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd2c6-dc5e-4be5-9872-1decedc1de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:59.563940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-64cdd2c6-dc5e-4be5-9872-1decedc1de61 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:05:59.565129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-64cdd2c6-dc5e-4be5-9872-1decedc1de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:05:59.572894 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 487/960] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:05:59 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:05:59.609914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305c7f-412a-46bb-8b01-615b224c0d39 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:05:59.620423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305c7f-412a-46bb-8b01-615b224c0d39 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:05:59.624253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:05:59.624882 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:05:59.625166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:05:59.625447 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:05:59.634230 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:05:59.635776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fbdf-24ba-4b0d-a7dc-4c537818cd56 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:05:59.645823 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 474/961] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:05:59 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:03.795952 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310542e-0c99-47ac-9f5b-8851f4e91f5f None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:03.796464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310542e-0c99-47ac-9f5b-8851f4e91f5f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:03.796464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310542e-0c99-47ac-9f5b-8851f4e91f5f None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:03.797825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 488/962] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:03.803074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8884-5216-46b6-ae09-a382958f45d1 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:03.803481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8884-5216-46b6-ae09-a382958f45d1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:03.803763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8884-5216-46b6-ae09-a382958f45d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:03.821361 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-28fe8884-5216-46b6-ae09-a382958f45d1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:03.822531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-28fe8884-5216-46b6-ae09-a382958f45d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:03.831229 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 475/963] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:03.870093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310542e-0c99-47ac-9f5b-8851f4e91f5f None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:03.881026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310542e-0c99-47ac-9f5b-8851f4e91f5f None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:03.884554 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:03.885186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:03.885469 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:03.885745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:03.895192 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:03.896630 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a25250-9647-44eb-b5ae-5a91740bcb05 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:03.906654 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 489/964] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:06.774154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af915-f822-406e-909a-68e7f9392a5a None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:06.774675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af915-f822-406e-909a-68e7f9392a5a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:06.774799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439af915-f822-406e-909a-68e7f9392a5a None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:06.776087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 476/965] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:06.781755 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257c0c-d8e0-4b7e-b3b5-68d776fffe02 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:06.782236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257c0c-d8e0-4b7e-b3b5-68d776fffe02 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:06.782330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257c0c-d8e0-4b7e-b3b5-68d776fffe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:06.800390 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-09257c0c-d8e0-4b7e-b3b5-68d776fffe02 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:06.801578 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-09257c0c-d8e0-4b7e-b3b5-68d776fffe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:06.809711 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 490/966] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:06 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:06.847795 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439af915-f822-406e-909a-68e7f9392a5a None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:06.858914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439af915-f822-406e-909a-68e7f9392a5a None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:06.862330 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:06.862990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:06.863275 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:06.863552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:06.872399 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:06.874123 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4838f-fa77-4cb7-9105-42415a266893 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:06.884175 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 477/967] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:06 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:11.407688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f912b9-a3db-4a6e-92b3-8708de1bd78c None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:11.408174 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f912b9-a3db-4a6e-92b3-8708de1bd78c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:11.408259 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f912b9-a3db-4a6e-92b3-8708de1bd78c None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:11.409662 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 491/968] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:11.414853 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ee29-6ba1-4f41-93d8-99ee3f20aba6 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:11.415248 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ee29-6ba1-4f41-93d8-99ee3f20aba6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:11.415415 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427ee29-6ba1-4f41-93d8-99ee3f20aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:11.421359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=54 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:06:11.433786 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4427ee29-6ba1-4f41-93d8-99ee3f20aba6 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:11.435069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4427ee29-6ba1-4f41-93d8-99ee3f20aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:11.446121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 478/969] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:11.482332 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f912b9-a3db-4a6e-92b3-8708de1bd78c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:11.493238 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f912b9-a3db-4a6e-92b3-8708de1bd78c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:11.496903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:11.497864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:11.498213 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:11.498496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:11.507604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:11.509013 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4754-daa8-46da-a4df-13b36ee3fdb2 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:11.519012 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 492/970] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:17.073261 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4535-2bc6-457a-9466-1a98c784f199 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:17.073764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4535-2bc6-457a-9466-1a98c784f199 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:17.073869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4535-2bc6-457a-9466-1a98c784f199 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:17.075811 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 479/971] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:17.081361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac1c1a-9417-430d-bd26-2db25dce44c6 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:17.081775 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac1c1a-9417-430d-bd26-2db25dce44c6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:17.081920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac1c1a-9417-430d-bd26-2db25dce44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:17.132632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-55ac1c1a-9417-430d-bd26-2db25dce44c6 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:17.134308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-55ac1c1a-9417-430d-bd26-2db25dce44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:17.244087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 493/972] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:06:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:21.428837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=2 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:06:21.569371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce56-8973-42ce-8f37-0beaff1f6da5 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:21.569659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce56-8973-42ce-8f37-0beaff1f6da5 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:21.570137 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce56-8973-42ce-8f37-0beaff1f6da5 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:21.571843 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 480/973] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:21.580024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008ef9-6bed-479a-96b9-6d07546c5631 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:21.580879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008ef9-6bed-479a-96b9-6d07546c5631 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:21.581168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008ef9-6bed-479a-96b9-6d07546c5631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:21.602585 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-06008ef9-6bed-479a-96b9-6d07546c5631 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:21.603872 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-06008ef9-6bed-479a-96b9-6d07546c5631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:21.613737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 494/974] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:06:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:23.086943 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4ca7-ee31-4943-94f3-2b730cd25b57 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:23.087476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4ca7-ee31-4943-94f3-2b730cd25b57 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:23.087476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4ca7-ee31-4943-94f3-2b730cd25b57 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:23.088873 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 481/975] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:23.094597 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b264-8481-4b29-a9ae-1f2dc68a1956 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:23.095060 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b264-8481-4b29-a9ae-1f2dc68a1956 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:23.095186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b264-8481-4b29-a9ae-1f2dc68a1956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:23.115486 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-90f8b264-8481-4b29-a9ae-1f2dc68a1956 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:23.117017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-90f8b264-8481-4b29-a9ae-1f2dc68a1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:23.131558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 495/976] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:06:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:27.077190 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3a10-f19d-4f3a-a2c4-ff7d097f1892 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:27.077759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3a10-f19d-4f3a-a2c4-ff7d097f1892 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:27.077759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3a10-f19d-4f3a-a2c4-ff7d097f1892 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:27.079502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 482/977] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:27.084458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a93a6f-7c62-421b-a230-dcfe477a99cc None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:27.084855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a93a6f-7c62-421b-a230-dcfe477a99cc None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:27.085086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a93a6f-7c62-421b-a230-dcfe477a99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:27.091414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=69 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:06:27.104345 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-72a93a6f-7c62-421b-a230-dcfe477a99cc None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:27.106017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-72a93a6f-7c62-421b-a230-dcfe477a99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:27.113978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 496/978] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:27.172679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135535a2-2bc3-4fe4-ad8a-4f44a97e93b6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:27.173263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135535a2-2bc3-4fe4-ad8a-4f44a97e93b6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:27.173784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135535a2-2bc3-4fe4-ad8a-4f44a97e93b6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:27.175505 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 483/979] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 12 10:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:27.184729 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921fcd5-1a21-4c7a-abe2-e6521615875c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:27.185437 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921fcd5-1a21-4c7a-abe2-e6521615875c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:27.186100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921fcd5-1a21-4c7a-abe2-e6521615875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:27.229212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c921fcd5-1a21-4c7a-abe2-e6521615875c None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:27.231539 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c921fcd5-1a21-4c7a-abe2-e6521615875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:27.308619 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 497/980] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 12 10:06:27 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:27.316314 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135535a2-2bc3-4fe4-ad8a-4f44a97e93b6 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:27.330378 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135535a2-2bc3-4fe4-ad8a-4f44a97e93b6 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:27.335433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:27.336153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:27.336510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:27.336860 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:27.345155 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:27.346868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a289f9-ca52-4107-bfc9-7807b34cffd3 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:27.356765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 484/981] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:29.829410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793da7-a305-4c15-ae58-a32a55d92a9b None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:29.829946 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793da7-a305-4c15-ae58-a32a55d92a9b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:29.829946 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793da7-a305-4c15-ae58-a32a55d92a9b None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:29.831386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 498/982] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:29.836584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15803-4d3f-402e-9275-96fbc4ff1489 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:29.837026 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15803-4d3f-402e-9275-96fbc4ff1489 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:29.837149 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15803-4d3f-402e-9275-96fbc4ff1489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:29.856320 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-cba15803-4d3f-402e-9275-96fbc4ff1489 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:29.857536 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-cba15803-4d3f-402e-9275-96fbc4ff1489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:29.865718 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 485/983] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:29.910627 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793da7-a305-4c15-ae58-a32a55d92a9b None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:29.926394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793da7-a305-4c15-ae58-a32a55d92a9b None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:29.932856 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:29.934076 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:29.934366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:29.934649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:29.943886 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:29.945502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13574-1706-4a90-b0c6-d916b8a08fde service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:29.956323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 499/984] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:32.514040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632a2b8-5f4b-463d-92a2-8243346cfe94 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:32.514544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632a2b8-5f4b-463d-92a2-8243346cfe94 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:32.514544 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632a2b8-5f4b-463d-92a2-8243346cfe94 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:32.515928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 486/985] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:32.521052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c7b8-6772-4f01-8843-e0ead62b6f78 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:32.521451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c7b8-6772-4f01-8843-e0ead62b6f78 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:32.521621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4c7b8-6772-4f01-8843-e0ead62b6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:32.539569 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-7db4c7b8-6772-4f01-8843-e0ead62b6f78 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:32.540788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-7db4c7b8-6772-4f01-8843-e0ead62b6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:32.553905 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 500/986] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:32.600828 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e692e-2fbf-442f-993f-8a5510a56b07 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:32.601124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e692e-2fbf-442f-993f-8a5510a56b07 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:32.601408 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e692e-2fbf-442f-993f-8a5510a56b07 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:32.602814 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 487/987] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 12 10:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:32.609545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225d3-03cc-4222-bd69-92173dc84c90 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:32.609874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225d3-03cc-4222-bd69-92173dc84c90 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:32.610124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225d3-03cc-4222-bd69-92173dc84c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:32.636953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-75c225d3-03cc-4222-bd69-92173dc84c90 None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:32.638435 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-75c225d3-03cc-4222-bd69-92173dc84c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:32.648367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 501/988] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 12 10:06:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:32.659242 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e692e-2fbf-442f-993f-8a5510a56b07 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:32.673559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e692e-2fbf-442f-993f-8a5510a56b07 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:32.679259 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:32.679850 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:32.680136 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:32.680416 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:32.689928 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:32.691738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edb98d-178d-476d-9b05-be39de716d0a service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:32.702491 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 488/989] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:35.035189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cad36-952a-4739-a443-166588a6d458 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:35.035721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cad36-952a-4739-a443-166588a6d458 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:35.035721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cad36-952a-4739-a443-166588a6d458 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:35.037393 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 502/990] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:35.043180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96827644-479c-4c1e-b185-2eaa19852811 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:35.043609 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96827644-479c-4c1e-b185-2eaa19852811 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:35.043744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96827644-479c-4c1e-b185-2eaa19852811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:35.063674 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-96827644-479c-4c1e-b185-2eaa19852811 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:35.065315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-96827644-479c-4c1e-b185-2eaa19852811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:35.074220 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 489/991] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:35.131956 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cad36-952a-4739-a443-166588a6d458 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:35.147052 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cad36-952a-4739-a443-166588a6d458 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:35.153418 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:35.154385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:35.154917 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:35.155422 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:35.165597 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:35.168039 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e6030-04fb-4db4-8528-b07988907b1e service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:35.178723 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 503/992] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:06:37.138167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9bad8-68cd-4780-852d-589908770ba6 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.138682 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9bad8-68cd-4780-852d-589908770ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.138894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9bad8-68cd-4780-852d-589908770ba6 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.143180 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 490/993] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:37.145673 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ed6e-6206-410e-9227-8df378a0e813 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.146114 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ed6e-6206-410e-9227-8df378a0e813 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.146234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ed6e-6206-410e-9227-8df378a0e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.164996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-1d37ed6e-6206-410e-9227-8df378a0e813 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:37.166581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-1d37ed6e-6206-410e-9227-8df378a0e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:37.176555 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 504/994] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:37.504325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bb06-82ac-46f2-a836-ec4d69019ed4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.505000 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bb06-82ac-46f2-a836-ec4d69019ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.505548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bb06-82ac-46f2-a836-ec4d69019ed4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.507554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 491/995] 10.222.0.44 () {54 vars in 963 bytes} [Tue Jul 12 10:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:37.518098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.518471 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.518865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.567874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] MFA Rules not processed for user `97d93a53678a488c91c017c500f9c4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:37.569166 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:37.591028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e482e9-3688-4708-8548-0d0f885f19bd None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.591318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e482e9-3688-4708-8548-0d0f885f19bd None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.591598 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e482e9-3688-4708-8548-0d0f885f19bd None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.592981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 492/996] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:06:37.598340 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.598637 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.598977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.621636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:37.623236 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:37.632893 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 493/997] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:37.636164 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 505/998] 10.222.0.44 () {58 vars in 1060 bytes} [Tue Jul 12 10:06:37 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:37.643951 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:37.654664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b0f8-d3ae-4a29-8c88-255acdd798f3 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:37.658330 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d93a53678a488c91c017c500f9c4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:37.659872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.660535 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.660917 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.675145 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:37.676762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce38b8-14d4-4b51-b5cf-9c825b221b8f service cinder] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:37.680103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:37.689164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 494/999] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:37.695373 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7450f0d-8da9-4ca4-8ee2-77d53300ad03 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:37.700738 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:37.701416 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:37.701698 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:37.701978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:37.711387 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:37.713031 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ebe28-77c9-4740-bf99-3c8de6a04471 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:37.717825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:06:37.726063 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 506/1000] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:40.046195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4d1b-0126-4bf1-963a-c7598ab13cfc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:40.046640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4d1b-0126-4bf1-963a-c7598ab13cfc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:40.047120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4d1b-0126-4bf1-963a-c7598ab13cfc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:40.048163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 495/1001] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:40.053653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc478e-eb31-4537-bd69-75e95edf26e9 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:40.054103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc478e-eb31-4537-bd69-75e95edf26e9 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:40.054223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc478e-eb31-4537-bd69-75e95edf26e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:40.074490 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4ecc478e-eb31-4537-bd69-75e95edf26e9 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:40.075813 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4ecc478e-eb31-4537-bd69-75e95edf26e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:40.083829 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 507/1002] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:40.130927 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4d1b-0126-4bf1-963a-c7598ab13cfc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:40.146338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4d1b-0126-4bf1-963a-c7598ab13cfc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:40.151393 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:40.152070 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:40.152357 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:40.152647 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:40.161328 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:40.162954 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1b4c5-2fae-4be2-bbad-4b37324784ae service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:40.173389 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 496/1003] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:42.470485 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751a4f-3c83-42bd-9d5f-3b53c8b9e6a1 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:42.471404 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751a4f-3c83-42bd-9d5f-3b53c8b9e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:42.471777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751a4f-3c83-42bd-9d5f-3b53c8b9e6a1 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:42.473597 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 508/1004] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:42.478494 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ddad-f22d-43d1-bfb2-26b01f760714 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:42.478980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ddad-f22d-43d1-bfb2-26b01f760714 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:42.479085 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ddad-f22d-43d1-bfb2-26b01f760714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:42.497764 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-38a2ddad-f22d-43d1-bfb2-26b01f760714 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:42.499244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-38a2ddad-f22d-43d1-bfb2-26b01f760714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:42.507069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 497/1005] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:42.549218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751a4f-3c83-42bd-9d5f-3b53c8b9e6a1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:42.564922 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751a4f-3c83-42bd-9d5f-3b53c8b9e6a1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:42.570739 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:42.571523 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:42.571909 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:42.572480 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:42.581497 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:42.583143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80001d-da72-485c-ae58-91181059ef1e service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:42.595412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 509/1006] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:44.876015 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6cc37-16ce-42e7-994b-a2625726f2b2 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:44.876576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6cc37-16ce-42e7-994b-a2625726f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:44.876815 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6cc37-16ce-42e7-994b-a2625726f2b2 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:44.878315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 498/1007] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:44.883635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45d32-7094-4337-b713-4bf885523388 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:44.884035 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45d32-7094-4337-b713-4bf885523388 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:44.884220 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45d32-7094-4337-b713-4bf885523388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:44.902819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-e3a45d32-7094-4337-b713-4bf885523388 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:44.904121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-e3a45d32-7094-4337-b713-4bf885523388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:44.912143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 510/1008] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:44.957602 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6cc37-16ce-42e7-994b-a2625726f2b2 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:44.972163 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6cc37-16ce-42e7-994b-a2625726f2b2 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:44.977052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:44.977795 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:44.978302 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:44.978804 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:44.988129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:44.989894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ae889-d85a-4eca-900b-5fc9fc518c7c service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:45.001846 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 499/1009] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:47.402507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d83b3-d68e-4c74-bdce-70512e3aff5c None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:47.403142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d83b3-d68e-4c74-bdce-70512e3aff5c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:47.403142 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d83b3-d68e-4c74-bdce-70512e3aff5c None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:47.404493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 511/1010] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:06:47.410765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8b86-e1ba-4f41-8747-88abeb6729d9 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:47.411187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8b86-e1ba-4f41-8747-88abeb6729d9 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:47.411355 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb8b86-e1ba-4f41-8747-88abeb6729d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:47.430068 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4feb8b86-e1ba-4f41-8747-88abeb6729d9 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:47.431319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4feb8b86-e1ba-4f41-8747-88abeb6729d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:47.439734 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 500/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:47.486328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d83b3-d68e-4c74-bdce-70512e3aff5c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:47.504188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d83b3-d68e-4c74-bdce-70512e3aff5c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:47.510429 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:47.511877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:47.512236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:47.512594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:47.523084 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:47.525211 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52683-6399-461e-bb2a-30b8fa277260 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:47.538220 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 512/1012] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:50.310421 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299f27-e914-4fa0-960d-5067dfdf0e59 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:50.311077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299f27-e914-4fa0-960d-5067dfdf0e59 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:50.311077 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299f27-e914-4fa0-960d-5067dfdf0e59 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:50.312434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 501/1013] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:06:50.317630 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a30465-ac13-4172-afe5-404abdb443d0 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:50.318149 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a30465-ac13-4172-afe5-404abdb443d0 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:50.318329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a30465-ac13-4172-afe5-404abdb443d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:50.336561 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c6a30465-ac13-4172-afe5-404abdb443d0 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:50.337718 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c6a30465-ac13-4172-afe5-404abdb443d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:50.346369 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 513/1014] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:50.395480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299f27-e914-4fa0-960d-5067dfdf0e59 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:50.413817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299f27-e914-4fa0-960d-5067dfdf0e59 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:50.419212 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:50.419869 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:50.420158 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:50.420442 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:50.429461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:50.431108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4635e-fcaf-4b79-82a4-20a5af76b4e5 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:50.440884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 502/1015] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:53.223056 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28588b-205f-4c6d-bd1c-14cdc1c0b85a None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.223687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28588b-205f-4c6d-bd1c-14cdc1c0b85a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.223687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28588b-205f-4c6d-bd1c-14cdc1c0b85a None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.225024 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 514/1016] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:53.230232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61827d-c06d-45d1-a659-280590b50b0b None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.230694 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61827d-c06d-45d1-a659-280590b50b0b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.230922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61827d-c06d-45d1-a659-280590b50b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.237441 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=52 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:06:53.251463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-fc61827d-c06d-45d1-a659-280590b50b0b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:53.252661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-fc61827d-c06d-45d1-a659-280590b50b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:53.261307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 503/1017] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:53.305347 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28588b-205f-4c6d-bd1c-14cdc1c0b85a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:53.319285 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28588b-205f-4c6d-bd1c-14cdc1c0b85a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:53.325136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:53.325781 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.326100 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.326384 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.334838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:53.336442 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63867e7-2532-4169-920d-298f5547bb58 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:53.345920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 515/1018] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:53.769107 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a74a1-d21b-4114-8a54-d6a6030b55b8 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.769519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a74a1-d21b-4114-8a54-d6a6030b55b8 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.769803 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a74a1-d21b-4114-8a54-d6a6030b55b8 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.771235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 504/1019] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:53.776810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cbd7-83ba-4599-9084-b366db537f73 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.777103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cbd7-83ba-4599-9084-b366db537f73 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.777385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cbd7-83ba-4599-9084-b366db537f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.795583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-0244cbd7-83ba-4599-9084-b366db537f73 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:53.796759 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-0244cbd7-83ba-4599-9084-b366db537f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:53.804472 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 516/1020] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:53.860714 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbc87-8c4e-4fad-8c18-907d77cf97bc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.861003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbc87-8c4e-4fad-8c18-907d77cf97bc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.861282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbc87-8c4e-4fad-8c18-907d77cf97bc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.862640 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 505/1021] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 12 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:53.867674 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef7a6-1134-4f4f-a296-745a23485d33 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.868008 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef7a6-1134-4f4f-a296-745a23485d33 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.868297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ef7a6-1134-4f4f-a296-745a23485d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.904753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-bd5ef7a6-1134-4f4f-a296-745a23485d33 None None] MFA Rules not processed for user `a3aa6ce16a904a6f9ebf67c6cd3e935b`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:53.905940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-bd5ef7a6-1134-4f4f-a296-745a23485d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:53.965467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 517/1022] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 12 10:06:53 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:06:53.972835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fbc87-8c4e-4fad-8c18-907d77cf97bc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:53.983950 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fbc87-8c4e-4fad-8c18-907d77cf97bc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:53.987391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6ce16a904a6f9ebf67c6cd3e935b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:53.988018 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:53.988301 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:53.988576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:53.997697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:53.999159 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cff453-9aa7-409b-8a53-5ca61895557e service glance] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:54.008742 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 506/1023] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:06:55.616690 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0be35-977b-4293-83af-c23947b4cf98 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:55.617328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0be35-977b-4293-83af-c23947b4cf98 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:55.617328 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0be35-977b-4293-83af-c23947b4cf98 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:55.618604 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 518/1024] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:06:55.624293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1cc6d-e549-4240-8a20-f48fcc46f6cf None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:55.624758 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1cc6d-e549-4240-8a20-f48fcc46f6cf None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:55.624863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1cc6d-e549-4240-8a20-f48fcc46f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:55.643322 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-55f1cc6d-e549-4240-8a20-f48fcc46f6cf None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:06:55.645763 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-55f1cc6d-e549-4240-8a20-f48fcc46f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:06:55.653043 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 507/1025] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:06:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:06:55.698444 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0be35-977b-4293-83af-c23947b4cf98 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:06:55.713172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0be35-977b-4293-83af-c23947b4cf98 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:06:55.718626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:06:55.719301 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:06:55.719582 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:06:55.719860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:06:55.730140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:06:55.731791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bbf9c-5915-4994-aa2f-775f25c3872e service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:06:55.743400 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 519/1026] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:06:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:05.637971 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=11 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:07:05.737160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=70 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:07:09.278215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b603-53e3-483e-8446-326490f4a9d4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:09.278931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b603-53e3-483e-8446-326490f4a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:09.278931 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b603-53e3-483e-8446-326490f4a9d4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:09.280191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 508/1027] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jul 12 10:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:09.285711 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b46e5-8280-473b-8678-2158de5c3bd4 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:09.286146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b46e5-8280-473b-8678-2158de5c3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:09.286298 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b46e5-8280-473b-8678-2158de5c3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:09.304380 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-5c3b46e5-8280-473b-8678-2158de5c3bd4 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:09.305592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-5c3b46e5-8280-473b-8678-2158de5c3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:09.315657 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 520/1028] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 10:07:09 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:09.330050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f61d8-f054-4eb4-bc7e-2441e0f8763c None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:09.330344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f61d8-f054-4eb4-bc7e-2441e0f8763c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:09.330626 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f61d8-f054-4eb4-bc7e-2441e0f8763c None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:09.332033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 509/1029] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jul 12 10:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:09.336596 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10e45-fb7a-4ecf-af3b-6ad7c8a2bcad None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:09.336885 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10e45-fb7a-4ecf-af3b-6ad7c8a2bcad None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:09.337173 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff10e45-fb7a-4ecf-af3b-6ad7c8a2bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:09.355936 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-2ff10e45-fb7a-4ecf-af3b-6ad7c8a2bcad None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:09.357128 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-2ff10e45-fb7a-4ecf-af3b-6ad7c8a2bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:09.365811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 521/1030] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 12 10:07:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:07:12.079875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668da0-a02e-4dc9-9370-723a476fa824 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:12.080444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668da0-a02e-4dc9-9370-723a476fa824 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:12.080444 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668da0-a02e-4dc9-9370-723a476fa824 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:12.081806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 510/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:12.086976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a09-fce0-40be-9470-80e94636a8bf None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:12.087355 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a09-fce0-40be-9470-80e94636a8bf None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:12.087541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5a09-fce0-40be-9470-80e94636a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:12.105637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c20a5a09-fce0-40be-9470-80e94636a8bf None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:12.106862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c20a5a09-fce0-40be-9470-80e94636a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:12.114559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 522/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:12.158459 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668da0-a02e-4dc9-9370-723a476fa824 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:12.172619 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668da0-a02e-4dc9-9370-723a476fa824 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:12.177520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:12.178151 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:12.178442 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:12.178745 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:12.187424 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:12.189030 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d98ad-5d03-4589-a270-6e4d73417576 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:12.198633 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 511/1033] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:07:13.147878 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1c14-502a-496f-a759-d2f440d98412 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:13.148416 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1c14-502a-496f-a759-d2f440d98412 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:13.148416 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1c14-502a-496f-a759-d2f440d98412 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:13.149809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 523/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:13.155284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0940-965b-4242-ae90-b3cfafaa022a None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:13.155729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0940-965b-4242-ae90-b3cfafaa022a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:13.155835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0940-965b-4242-ae90-b3cfafaa022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:13.174100 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-8c7f0940-965b-4242-ae90-b3cfafaa022a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:13.175358 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-8c7f0940-965b-4242-ae90-b3cfafaa022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:13.183170 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 512/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:07:13.367605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1c14-502a-496f-a759-d2f440d98412 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:13.381432 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1c14-502a-496f-a759-d2f440d98412 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:13.386980 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:13.387621 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:13.387900 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:13.388177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:13.396784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:13.398476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f0f8-bdbc-45de-8b90-f4e9a7db2c4a service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:13.407977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 524/1036] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:14.306769 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de974d-3c03-437d-9c15-62ddcd55e40a None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:14.307792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de974d-3c03-437d-9c15-62ddcd55e40a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:14.307888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de974d-3c03-437d-9c15-62ddcd55e40a None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:14.309211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 513/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:14.314256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d3e1-b8aa-4cdc-abea-a3f485185a62 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:14.314644 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d3e1-b8aa-4cdc-abea-a3f485185a62 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:14.314854 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0d3e1-b8aa-4cdc-abea-a3f485185a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:14.333745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-aec0d3e1-b8aa-4cdc-abea-a3f485185a62 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:14.334971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-aec0d3e1-b8aa-4cdc-abea-a3f485185a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:14.343874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 525/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:14.500161 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de974d-3c03-437d-9c15-62ddcd55e40a None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:14.513915 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de974d-3c03-437d-9c15-62ddcd55e40a None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:14.518655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:14.519307 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:14.519590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:14.519866 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:14.528545 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:14.530131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a379c9-fe6a-4648-b187-cc7e232d179f service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:14.539312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 514/1039] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:15.401679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602bf6-a65d-40c6-a424-e2af0c93230c None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:15.402160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602bf6-a65d-40c6-a424-e2af0c93230c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:15.402274 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad602bf6-a65d-40c6-a424-e2af0c93230c None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:15.403642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 526/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:15.408528 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba6f6-5bc1-463b-821e-04b6cccae879 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:15.408963 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba6f6-5bc1-463b-821e-04b6cccae879 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:15.409074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aba6f6-5bc1-463b-821e-04b6cccae879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:15.426960 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-39aba6f6-5bc1-463b-821e-04b6cccae879 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:15.428187 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-39aba6f6-5bc1-463b-821e-04b6cccae879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:15.436049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 515/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:15.590964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad602bf6-a65d-40c6-a424-e2af0c93230c None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:15.604814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad602bf6-a65d-40c6-a424-e2af0c93230c None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:15.609659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:15.610286 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:15.610566 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:15.610875 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:15.618697 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:15.620329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2405db-a849-44f1-93bc-c8b38c134975 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:15.629934 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 527/1042] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:16.493321 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725de4f-78b4-4fd7-9cf4-894b74facba5 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:16.493874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725de4f-78b4-4fd7-9cf4-894b74facba5 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:16.493874 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725de4f-78b4-4fd7-9cf4-894b74facba5 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:16.495900 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 516/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:16.501112 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fcd7-ba63-4a2e-9a0c-46ebe4f0b88f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:16.501489 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fcd7-ba63-4a2e-9a0c-46ebe4f0b88f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:16.501680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fcd7-ba63-4a2e-9a0c-46ebe4f0b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:16.520048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a739fcd7-ba63-4a2e-9a0c-46ebe4f0b88f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:16.521171 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a739fcd7-ba63-4a2e-9a0c-46ebe4f0b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:16.529190 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 528/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:16.685112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725de4f-78b4-4fd7-9cf4-894b74facba5 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:16.698684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725de4f-78b4-4fd7-9cf4-894b74facba5 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:16.703529 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:16.704153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:16.704434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:16.704711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:16.712648 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:16.714808 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07391b42-1ec6-4a03-bd8a-76a11a7def05 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:16.723944 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 517/1045] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:17.532372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300b25-f114-4d77-81cc-eab4c8916964 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:17.532927 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300b25-f114-4d77-81cc-eab4c8916964 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:17.532927 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f300b25-f114-4d77-81cc-eab4c8916964 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:17.534313 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 529/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:17.539270 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1bc5-9495-4c3d-9b61-dc625096486e None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:17.539675 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1bc5-9495-4c3d-9b61-dc625096486e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:17.539827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1bc5-9495-4c3d-9b61-dc625096486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:17.558205 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-f31a1bc5-9495-4c3d-9b61-dc625096486e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:17.559434 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-f31a1bc5-9495-4c3d-9b61-dc625096486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:17.567083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 518/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:17.720532 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f300b25-f114-4d77-81cc-eab4c8916964 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:17.734158 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f300b25-f114-4d77-81cc-eab4c8916964 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:17.739033 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:17.739668 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:17.739951 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:17.740229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:17.748959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:17.750551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce15cbf-ecd4-438b-94a9-b731b022723a service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:17.759773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 530/1048] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:18.563213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520448b3-1e2e-4318-ac91-1c1aa7e2aee4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:18.563760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520448b3-1e2e-4318-ac91-1c1aa7e2aee4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:18.563760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520448b3-1e2e-4318-ac91-1c1aa7e2aee4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:18.565159 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 519/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:18.570247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d81d-b438-4476-b4a0-31e7bf91cf40 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:18.570657 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d81d-b438-4476-b4a0-31e7bf91cf40 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:18.570833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0d81d-b438-4476-b4a0-31e7bf91cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:18.590672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-f1f0d81d-b438-4476-b4a0-31e7bf91cf40 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:18.591950 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-f1f0d81d-b438-4476-b4a0-31e7bf91cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:18.600104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 531/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:07:18.754641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520448b3-1e2e-4318-ac91-1c1aa7e2aee4 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:18.768574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520448b3-1e2e-4318-ac91-1c1aa7e2aee4 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:18.773454 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:18.774090 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:18.774374 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:18.774650 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:18.782622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:18.784274 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3b9e-2105-4bf8-aeb0-9ffe8274da56 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:18.793506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 520/1051] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:19.599905 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9082669-0a43-4541-9100-56a12964096d None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:19.600461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9082669-0a43-4541-9100-56a12964096d None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:19.600461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9082669-0a43-4541-9100-56a12964096d None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:19.601803 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 532/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:19.607115 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c056-8b17-4e2f-a9f9-46f9bea2f34f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:19.607552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c056-8b17-4e2f-a9f9-46f9bea2f34f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:19.607669 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c056-8b17-4e2f-a9f9-46f9bea2f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:19.626062 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-f6e6c056-8b17-4e2f-a9f9-46f9bea2f34f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:19.627296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-f6e6c056-8b17-4e2f-a9f9-46f9bea2f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:19.635057 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 521/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:19.788116 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9082669-0a43-4541-9100-56a12964096d None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:19.802452 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9082669-0a43-4541-9100-56a12964096d None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:19.808091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:19.808725 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:19.809009 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:19.809287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:19.817431 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:19.819061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db688-49ca-423a-ad5f-6c4e87063f70 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:19.828538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 533/1054] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:20.641453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda7e36-7c0a-4d65-bc8d-15fa4b6aeded None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:20.642014 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda7e36-7c0a-4d65-bc8d-15fa4b6aeded None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:20.642014 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda7e36-7c0a-4d65-bc8d-15fa4b6aeded None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:20.643437 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 522/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:20.648345 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47099c2e-262c-4826-8865-3b590bca9fef None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:20.648745 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47099c2e-262c-4826-8865-3b590bca9fef None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:20.648981 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47099c2e-262c-4826-8865-3b590bca9fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:20.667124 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-47099c2e-262c-4826-8865-3b590bca9fef None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:20.668308 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-47099c2e-262c-4826-8865-3b590bca9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:20.676266 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 534/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:07:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:20.828868 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda7e36-7c0a-4d65-bc8d-15fa4b6aeded None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:20.842391 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda7e36-7c0a-4d65-bc8d-15fa4b6aeded None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:20.847549 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:20.848194 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:20.848483 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:20.848789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:20.857731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:20.859364 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53204f9-3c3d-451a-89fa-9ee83696dba2 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:20.868766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 523/1057] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:22.986386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e67689-a735-4c1d-ae82-a99f7a4b4787 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:22.986955 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e67689-a735-4c1d-ae82-a99f7a4b4787 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:22.986955 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e67689-a735-4c1d-ae82-a99f7a4b4787 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:22.988359 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 535/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:22.993747 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac9a9b-b544-4f68-a52b-d3bd3da77500 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:22.994643 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac9a9b-b544-4f68-a52b-d3bd3da77500 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:22.994831 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac9a9b-b544-4f68-a52b-d3bd3da77500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:23.013253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-35ac9a9b-b544-4f68-a52b-d3bd3da77500 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:23.014433 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-35ac9a9b-b544-4f68-a52b-d3bd3da77500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:23.022071 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 524/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:23.061010 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e67689-a735-4c1d-ae82-a99f7a4b4787 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:23.073065 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e67689-a735-4c1d-ae82-a99f7a4b4787 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:23.076609 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:23.077244 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:23.077525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:23.077796 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:23.086623 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:23.088179 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaef502-4826-4f52-ac0a-f6afaca83334 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:23.097396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 536/1060] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:25.463312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801738-f192-4371-a38f-0f6126ead4e5 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:25.463863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801738-f192-4371-a38f-0f6126ead4e5 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:25.463863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801738-f192-4371-a38f-0f6126ead4e5 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:25.465245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 525/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:25.470549 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a22-2648-4b7a-8314-6c0949bf75b5 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:25.471014 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a22-2648-4b7a-8314-6c0949bf75b5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:25.471150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80a22-2648-4b7a-8314-6c0949bf75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:25.488402 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-17c80a22-2648-4b7a-8314-6c0949bf75b5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:25.489579 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-17c80a22-2648-4b7a-8314-6c0949bf75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:25.498093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 537/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:25.536611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60801738-f192-4371-a38f-0f6126ead4e5 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:25.547371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60801738-f192-4371-a38f-0f6126ead4e5 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:25.550964 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:25.551603 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:25.551888 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:25.552168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:25.561636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:25.563102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e65c0d-6965-4cf8-8e3b-b6d322343bb9 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:25.573014 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 526/1063] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:28.097327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec3ea-c7ab-4d21-85f3-3aac21b8daf6 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:28.097863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec3ea-c7ab-4d21-85f3-3aac21b8daf6 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:28.097863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec3ea-c7ab-4d21-85f3-3aac21b8daf6 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:28.099293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 538/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:28.104468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da002c-6ed1-4385-9e08-f5d54e0d7f48 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:28.104891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da002c-6ed1-4385-9e08-f5d54e0d7f48 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:28.105038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da002c-6ed1-4385-9e08-f5d54e0d7f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:28.122621 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-a8da002c-6ed1-4385-9e08-f5d54e0d7f48 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:28.123848 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-a8da002c-6ed1-4385-9e08-f5d54e0d7f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:28.131584 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 527/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:28.172136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcec3ea-c7ab-4d21-85f3-3aac21b8daf6 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:28.186622 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcec3ea-c7ab-4d21-85f3-3aac21b8daf6 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:28.192339 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:28.192969 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:28.193250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:28.193526 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:28.202878 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:28.204304 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcc9f0-3505-48d9-93ee-d9399b141dcf service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:28.213679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 539/1066] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:30.539051 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864a90-bbf9-4db4-81ac-b26ecf4896cc None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:30.539557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864a90-bbf9-4db4-81ac-b26ecf4896cc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:30.539557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864a90-bbf9-4db4-81ac-b26ecf4896cc None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:30.541525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 528/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:30.546994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210a93-e16b-4510-a492-a6eb92dc64e1 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:30.547447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210a93-e16b-4510-a492-a6eb92dc64e1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:30.547543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210a93-e16b-4510-a492-a6eb92dc64e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:30.564860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-4e210a93-e16b-4510-a492-a6eb92dc64e1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:30.566046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-4e210a93-e16b-4510-a492-a6eb92dc64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:30.574236 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 540/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:30.612821 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b864a90-bbf9-4db4-81ac-b26ecf4896cc None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:30.623685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b864a90-bbf9-4db4-81ac-b26ecf4896cc None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:30.627232 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:30.627864 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:30.628156 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:30.628435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:30.637276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:30.638802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80365c30-233c-4ea0-8346-8be0015422e5 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:30.648092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 529/1069] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:32.930036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08f13-8b2a-4438-a846-35d855db6b3e None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:32.930602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08f13-8b2a-4438-a846-35d855db6b3e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:32.930758 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08f13-8b2a-4438-a846-35d855db6b3e None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:32.932640 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 541/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:32.937930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6c2-1b47-4aa9-86f3-7cc7ea8afa1d None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:32.938350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6c2-1b47-4aa9-86f3-7cc7ea8afa1d None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:32.938501 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54a6c2-1b47-4aa9-86f3-7cc7ea8afa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:32.956731 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-2b54a6c2-1b47-4aa9-86f3-7cc7ea8afa1d None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:32.957863 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-2b54a6c2-1b47-4aa9-86f3-7cc7ea8afa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:32.966682 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 530/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:33.006247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee08f13-8b2a-4438-a846-35d855db6b3e None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:33.017669 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee08f13-8b2a-4438-a846-35d855db6b3e None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:33.021181 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:33.021819 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:33.022104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:33.022381 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:33.031212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:33.032692 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3663a8-86b7-466b-80f0-67b57c21629b service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:33.041934 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 542/1072] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:35.312552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc51e2-98c4-4a41-90c8-4e665dc74a2b None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:35.313078 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc51e2-98c4-4a41-90c8-4e665dc74a2b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:35.313191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc51e2-98c4-4a41-90c8-4e665dc74a2b None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:35.314480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 531/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:35.319940 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b00-fd74-4b5b-ab11-a436d59e2ccf None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:35.320374 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b00-fd74-4b5b-ab11-a436d59e2ccf None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:35.320507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac8b00-fd74-4b5b-ab11-a436d59e2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:35.338451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c0ac8b00-fd74-4b5b-ab11-a436d59e2ccf None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:35.339686 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c0ac8b00-fd74-4b5b-ab11-a436d59e2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:35.347559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 543/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:35.386429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc51e2-98c4-4a41-90c8-4e665dc74a2b None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:35.397297 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc51e2-98c4-4a41-90c8-4e665dc74a2b None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:35.401479 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:35.402099 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:35.402384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:35.402667 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:35.411668 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:35.413098 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50e7a-17f3-4c8f-9082-84e902270023 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:35.422673 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 532/1075] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:37.718111 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4316-c741-447b-8079-449d1a6f910a None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:37.718761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4316-c741-447b-8079-449d1a6f910a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:37.718761 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4316-c741-447b-8079-449d1a6f910a None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:37.720638 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 544/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:37.725430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d60ec-5f75-4b81-a7c8-dcca42a74d14 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:37.725831 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d60ec-5f75-4b81-a7c8-dcca42a74d14 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:37.725990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d60ec-5f75-4b81-a7c8-dcca42a74d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:37.732060 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=70 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:07:37.745178 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-182d60ec-5f75-4b81-a7c8-dcca42a74d14 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:37.746404 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-182d60ec-5f75-4b81-a7c8-dcca42a74d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:37.754679 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 533/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:37.794660 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4316-c741-447b-8079-449d1a6f910a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:37.799954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=73 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:07:37.807167 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4316-c741-447b-8079-449d1a6f910a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:37.810653 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:37.811324 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:37.811611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:37.811890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:37.820774 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:37.822865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a1411-7eb5-4a26-82b4-e96a62b68bd8 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:37.832470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 545/1078] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:40.109438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219c33-8258-44c1-bcbd-be1b762fece1 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:40.110096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219c33-8258-44c1-bcbd-be1b762fece1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:40.110096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219c33-8258-44c1-bcbd-be1b762fece1 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:40.111690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 534/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:40.116778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88501-fffc-4573-b0a7-2ac8c7dc6e86 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:40.117186 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88501-fffc-4573-b0a7-2ac8c7dc6e86 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:40.117340 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c88501-fffc-4573-b0a7-2ac8c7dc6e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:40.135530 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-c2c88501-fffc-4573-b0a7-2ac8c7dc6e86 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:40.136723 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-c2c88501-fffc-4573-b0a7-2ac8c7dc6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:40.144495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 546/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:40.182756 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219c33-8258-44c1-bcbd-be1b762fece1 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:40.194146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219c33-8258-44c1-bcbd-be1b762fece1 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:40.197711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:40.198342 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:40.198625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:40.198933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:40.207581 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:40.209064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfe48c-8359-4f19-8a0d-7a330e95a2b0 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:40.218460 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 535/1081] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:42.457636 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f4be-995f-4344-9c38-958df20bd2c1 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:42.458174 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f4be-995f-4344-9c38-958df20bd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:42.458283 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399f4be-995f-4344-9c38-958df20bd2c1 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:42.459666 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 547/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:42.465590 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02ca2-2420-44f4-9088-a7e4f445351c None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:42.466029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02ca2-2420-44f4-9088-a7e4f445351c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:42.466130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02ca2-2420-44f4-9088-a7e4f445351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:42.483346 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-2ae02ca2-2420-44f4-9088-a7e4f445351c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:42.484533 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-2ae02ca2-2420-44f4-9088-a7e4f445351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:42.492181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 536/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:42.531275 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399f4be-995f-4344-9c38-958df20bd2c1 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:42.541872 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399f4be-995f-4344-9c38-958df20bd2c1 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:42.545335 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:42.545972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:42.546256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:42.546534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:42.555711 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:42.557650 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e0336-cee0-47eb-80a0-b0a38a1dd69d service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:42.566862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 548/1084] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:44.810432 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ca5-2ad0-4962-a6a8-401b22fde538 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:44.811033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ca5-2ad0-4962-a6a8-401b22fde538 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:44.811142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ca5-2ad0-4962-a6a8-401b22fde538 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:44.812615 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 537/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:07:44.817908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20cfa-c728-48ec-80c3-81a772aba729 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:44.818356 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20cfa-c728-48ec-80c3-81a772aba729 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:44.818478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b20cfa-c728-48ec-80c3-81a772aba729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:44.836091 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-67b20cfa-c728-48ec-80c3-81a772aba729 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:07:44.837282 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-67b20cfa-c728-48ec-80c3-81a772aba729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:07:44.845559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 549/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:07:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:07:44.884038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36ca5-2ad0-4962-a6a8-401b22fde538 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:07:44.894885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36ca5-2ad0-4962-a6a8-401b22fde538 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:07:44.898384 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:07:44.899055 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:07:44.899344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:07:44.899625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:07:44.908979 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:07:44.910407 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9461ba4-3f1b-4a6b-8516-761e5bea8efa service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:07:44.920587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 538/1087] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:07:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:07:54.831148 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=17 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:07:54.916046 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=17 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:08:08.456946 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051b2a-f0b8-4c70-9f73-5450a7a714cd None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:08.457458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051b2a-f0b8-4c70-9f73-5450a7a714cd None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:08.457583 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65051b2a-f0b8-4c70-9f73-5450a7a714cd None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:08.458957 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 550/1088] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:08.464135 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7864-d371-49df-bdbf-a6dac3ef04d1 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:08.464548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7864-d371-49df-bdbf-a6dac3ef04d1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:08.464730 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7864-d371-49df-bdbf-a6dac3ef04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:08.482588 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-fa9f7864-d371-49df-bdbf-a6dac3ef04d1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:08.483822 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-fa9f7864-d371-49df-bdbf-a6dac3ef04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:08.491520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 539/1089] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:08.541150 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9269-c424-486a-905f-d46d1ad7b6e9 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:08.541439 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9269-c424-486a-905f-d46d1ad7b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:08.541721 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9269-c424-486a-905f-d46d1ad7b6e9 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:08.543130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 551/1090] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 12 10:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:08.548212 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368a9-11cb-4d10-ae82-35f0abf8af53 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:08.548498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368a9-11cb-4d10-ae82-35f0abf8af53 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:08.548773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce368a9-11cb-4d10-ae82-35f0abf8af53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:08.566974 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4ce368a9-11cb-4d10-ae82-35f0abf8af53 None None] MFA Rules not processed for user `a3aa6ce16a904a6f9ebf67c6cd3e935b`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:08.568154 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4ce368a9-11cb-4d10-ae82-35f0abf8af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:08.574466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 540/1091] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 12 10:08:08 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:08:08.581525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9269-c424-486a-905f-d46d1ad7b6e9 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:08.592011 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9269-c424-486a-905f-d46d1ad7b6e9 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:08.595637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6ce16a904a6f9ebf67c6cd3e935b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:08.596462 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:08.597042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:08.597522 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:08.608392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:08.609841 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e625be-41d4-4603-bd9d-fd8c9f11ee0d service glance] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:08.620026 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 552/1092] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:08:10.941959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318823-14a9-4dca-a470-297829914075 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:10.942610 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318823-14a9-4dca-a470-297829914075 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:10.942610 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318823-14a9-4dca-a470-297829914075 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:10.943948 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 541/1093] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:10.949637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cefc-6832-4b31-b4da-10cdf69ce4bb None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:10.950088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cefc-6832-4b31-b4da-10cdf69ce4bb None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:10.950191 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cefc-6832-4b31-b4da-10cdf69ce4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:10.968336 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-05f6cefc-6832-4b31-b4da-10cdf69ce4bb None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:10.969523 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-05f6cefc-6832-4b31-b4da-10cdf69ce4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:10.977292 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 553/1094] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:11.001712 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33318823-14a9-4dca-a470-297829914075 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:11.014458 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33318823-14a9-4dca-a470-297829914075 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:11.018831 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:11.019468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:11.019749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:11.020043 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:11.020766 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:11.022520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:08:11.022520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:08:11.022520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:08:11.023676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8885e-9b4d-4edf-a80c-643e25692511 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:11.041066 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 542/1095] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 12 10:08:11 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:08:13.286976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9d50-bfee-4e24-9d12-685042e19cba None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:13.287558 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9d50-bfee-4e24-9d12-685042e19cba None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:13.287665 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9d50-bfee-4e24-9d12-685042e19cba None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:13.288995 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 554/1096] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:13.294148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ca9-ae91-4b1b-b9a4-f74590c88290 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:13.294566 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ca9-ae91-4b1b-b9a4-f74590c88290 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:13.294771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85ca9-ae91-4b1b-b9a4-f74590c88290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:13.313989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6fc85ca9-ae91-4b1b-b9a4-f74590c88290 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:13.315208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6fc85ca9-ae91-4b1b-b9a4-f74590c88290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:13.323538 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 543/1097] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:13.365904 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e9d50-bfee-4e24-9d12-685042e19cba None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:13.380205 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e9d50-bfee-4e24-9d12-685042e19cba None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:13.385594 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:13.386228 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:13.386511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:13.386825 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:13.395068 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:13.396670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee24f7-b383-40b3-b22f-c8184998a252 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:13.406080 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 555/1098] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:08:15.779676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1835d5-a0eb-4da0-8156-dcc408985ba0 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:15.780201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1835d5-a0eb-4da0-8156-dcc408985ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:15.780201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1835d5-a0eb-4da0-8156-dcc408985ba0 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:15.781563 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 544/1099] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:15.786841 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4c2d-87b4-4791-9bae-39355c60c25f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:15.787262 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4c2d-87b4-4791-9bae-39355c60c25f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:15.787403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f4c2d-87b4-4791-9bae-39355c60c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:15.804710 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-222f4c2d-87b4-4791-9bae-39355c60c25f None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:15.806423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-222f4c2d-87b4-4791-9bae-39355c60c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:15.814079 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 556/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:15.850914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1835d5-a0eb-4da0-8156-dcc408985ba0 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:15.861894 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1835d5-a0eb-4da0-8156-dcc408985ba0 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:15.865386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:15.866011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:15.866298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:15.866577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:15.876312 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:15.877701 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9789a33-0ce4-4b16-b6de-3fe81c5baafa service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:15.887119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 545/1101] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:08:18.168658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4d42-5e27-4d3f-aded-3cb7c55c9778 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:18.169240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4d42-5e27-4d3f-aded-3cb7c55c9778 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:18.169240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b4d42-5e27-4d3f-aded-3cb7c55c9778 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:18.170620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 557/1102] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:18.175918 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8adad-f7c1-4f5a-9cf7-636f5b6fb3dc None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:18.176350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8adad-f7c1-4f5a-9cf7-636f5b6fb3dc None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:18.176484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8adad-f7c1-4f5a-9cf7-636f5b6fb3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:18.195370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-04a8adad-f7c1-4f5a-9cf7-636f5b6fb3dc None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:18.196585 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-04a8adad-f7c1-4f5a-9cf7-636f5b6fb3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:18.204253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 546/1103] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:18.241798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b4d42-5e27-4d3f-aded-3cb7c55c9778 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:18.253154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b4d42-5e27-4d3f-aded-3cb7c55c9778 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:18.256728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:18.257353 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:18.257637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:18.257913 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:18.266834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:18.268274 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665450-955f-4a85-a5ec-2077ffdae354 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:18.277635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 558/1104] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:08:20.619271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed344e1-eaa3-4ba6-bfb2-6031121b9e91 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:20.619839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed344e1-eaa3-4ba6-bfb2-6031121b9e91 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:20.619839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed344e1-eaa3-4ba6-bfb2-6031121b9e91 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:20.621506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 547/1105] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:20.626567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f59a3-2976-4ca6-99a5-9c05248fe094 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:20.626962 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f59a3-2976-4ca6-99a5-9c05248fe094 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:20.627074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f59a3-2976-4ca6-99a5-9c05248fe094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:20.644766 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-059f59a3-2976-4ca6-99a5-9c05248fe094 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:20.645942 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-059f59a3-2976-4ca6-99a5-9c05248fe094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:20.653778 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 559/1106] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:20.694574 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed344e1-eaa3-4ba6-bfb2-6031121b9e91 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:20.705567 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed344e1-eaa3-4ba6-bfb2-6031121b9e91 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:20.709139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:20.709773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:20.710060 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:20.710337 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:20.719253 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:20.720680 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68f01e-2a46-4582-bf2d-63a92ebdf349 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:20.730466 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 548/1107] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:08:23.223674 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33d37-faa7-47cd-8a8c-e455ceda38b4 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:23.224240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33d37-faa7-47cd-8a8c-e455ceda38b4 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:23.224240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33d37-faa7-47cd-8a8c-e455ceda38b4 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:23.225606 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 560/1108] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 12 10:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:08:23.231472 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890af2b-a517-47ec-a73c-13e98bebaa40 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:23.231885 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890af2b-a517-47ec-a73c-13e98bebaa40 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:23.232033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890af2b-a517-47ec-a73c-13e98bebaa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:23.249784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-2890af2b-a517-47ec-a73c-13e98bebaa40 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:08:23.251120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-2890af2b-a517-47ec-a73c-13e98bebaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:08:23.258896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 549/1109] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 12 10:08:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:08:23.298720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33d37-faa7-47cd-8a8c-e455ceda38b4 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:08:23.309392 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33d37-faa7-47cd-8a8c-e455ceda38b4 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:08:23.313019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:08:23.313649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:08:23.313934 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:08:23.314212 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:08:23.323074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:08:23.324538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28b36b-f45e-45b9-83f0-58df7011b038 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:08:23.333824 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 561/1110] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:08:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:08:33.244636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=33 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:08:33.329724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=33 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:09:50.738642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:50.739292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:50.739292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:50.757317 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:09:50.758498 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:50.766087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 550/1111] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:09:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:09:50.774121 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:50.774611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:50.774743 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:50.793853 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:09:50.795113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:50.803409 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 562/1112] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:09:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:09:50.807817 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:50.817451 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc77f1-5e76-4eb4-b12f-33095bbd56ae None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:50.821981 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:50.822625 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:50.822962 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:50.823242 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:50.823963 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:09:50.824282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:50.825289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:50.825289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:09:50.825289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:09:50.826195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:50.837481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 551/1113] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 12 10:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:09:50.845382 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:50.855246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfb661-b45c-450e-bf97-370e2165b3a7 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:50.859881 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:50.860529 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:50.860816 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:50.861096 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:50.861794 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:50.863615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:50.863615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:09:50.863615 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:09:50.864837 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:50.890570 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 563/1114] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 12 10:09:50 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:09:50.894604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:50.904796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8ae41-df61-4e1a-867e-7d9873e2a491 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:50.958429 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:50.959611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:50.959896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:50.960215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:50.961049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:50.962233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:50.962233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:09:50.962233 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:09:50.963457 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:50.983589 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 552/1115] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 12 10:09:50 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:09:50.987706 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:50.998321 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edeb8c-f63c-48dd-ba78-f55bd9cc5f68 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.002948 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.003601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.003883 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.004161 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.004890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.005935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:51.005935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:09:51.005935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:09:51.006862 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.020005 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 564/1116] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:09:51.024235 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:51.034010 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fae0f-a0cb-4049-90bf-322bb379a630 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.039306 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.039952 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.040238 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.040515 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.041241 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.042245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:51.042245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:09:51.042245 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:09:51.043164 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557ca5e-1fd3-4aad-9f28-1c4ebd651936 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.056594 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 553/1117] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:09:51.060704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:51.070677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b78785-b40f-4830-9227-326f9138b9c6 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.075531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.076393 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.076676 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.076954 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] PATH_INFO: `/v3/projects/d47bdc1b685a4817b2be8439a5c5d882/users/76fbd57c9a9a4a04b0cbae47b9c2b252/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.093966 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47bdc1b685a4817b2be8439a5c5d882, user_id=76fbd57c9a9a4a04b0cbae47b9c2b252, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.095036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:51.095036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:09:51.095036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:09:51.096997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d37fa-1264-42eb-83a4-f31b5071968c admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.110293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 565/1118] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:09:51 2022] PUT /identity/v3/projects/d47bdc1b685a4817b2be8439a5c5d882/users/76fbd57c9a9a4a04b0cbae47b9c2b252/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:09:51.122600 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959c8b-f87a-44a7-a3b7-664cab43a65f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.122929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959c8b-f87a-44a7-a3b7-664cab43a65f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.123215 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959c8b-f87a-44a7-a3b7-664cab43a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.150430 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-50959c8b-f87a-44a7-a3b7-664cab43a65f None None] MFA Rules not processed for user `76fbd57c9a9a4a04b0cbae47b9c2b252`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:09:51.151676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-50959c8b-f87a-44a7-a3b7-664cab43a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:51.214094 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 554/1119] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:09:51 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:09:51.227832 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7f95-876c-49ef-aee4-b39543735dfb None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.228127 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7f95-876c-49ef-aee4-b39543735dfb None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.228406 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7f95-876c-49ef-aee4-b39543735dfb None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.229762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 566/1120] 10.222.0.44 () {54 vars in 963 bytes} [Tue Jul 12 10:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:09:51.234506 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adae6c7-84db-45bc-803f-9624c829c58c None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.234831 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adae6c7-84db-45bc-803f-9624c829c58c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.235116 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adae6c7-84db-45bc-803f-9624c829c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.252835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-8adae6c7-84db-45bc-803f-9624c829c58c None None] MFA Rules not processed for user `97d93a53678a488c91c017c500f9c4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:09:51.254049 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-8adae6c7-84db-45bc-803f-9624c829c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:51.296375 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:09:51.304490 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 555/1121] 10.222.0.44 () {58 vars in 1060 bytes} [Tue Jul 12 10:09:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:09:51.311964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7f95-876c-49ef-aee4-b39543735dfb None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:51.322792 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7f95-876c-49ef-aee4-b39543735dfb None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.326172 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d93a53678a488c91c017c500f9c4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.326847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.327129 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.327397 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.335978 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.337389 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.345838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 567/1122] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:09:51 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:09:51.379977 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8feb8-43bc-43aa-9074-8492b7e69cab None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.380271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8feb8-43bc-43aa-9074-8492b7e69cab None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.380558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8feb8-43bc-43aa-9074-8492b7e69cab None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.382340 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 556/1123] 10.222.0.44 () {52 vars in 829 bytes} [Tue Jul 12 10:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:09:51.385899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:51.449207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3360f-e4fb-4b76-8a09-2c397f73a4d9 service cinder] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.453833 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.454693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.455007 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.455284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] PATH_INFO: `/v3/users/76fbd57c9a9a4a04b0cbae47b9c2b252` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.456488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fbd57c9a9a4a04b0cbae47b9c2b252)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.457505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:51.457505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:09:51.457505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:09:51.458733 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.521525 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fbd57c9a9a4a04b0cbae47b9c2b252'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:51.522137 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fbd57c9a9a4a04b0cbae47b9c2b252'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:51.540470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fbd57c9a9a4a04b0cbae47b9c2b252'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:51.552234 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fbd57c9a9a4a04b0cbae47b9c2b252'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:51.562043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fbd57c9a9a4a04b0cbae47b9c2b252'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:51.568144 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 568/1124] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 12 10:09:51 2022] DELETE /identity/v3/users/76fbd57c9a9a4a04b0cbae47b9c2b252 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:09:51.572557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.572881 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.573166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.590188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:09:51.591435 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:51.653699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 557/1125] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:09:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:09:51.663760 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:51.665151 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:51.670505 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:09:51.722118 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb94aa-e133-494d-a7d2-3f7c848ef042 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:51.726265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:51.726938 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:51.727219 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:51.727493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:51.736260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:51.737693 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85297a47-d786-43b9-bdf7-d8a932da7d04 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:51.747239 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 569/1126] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:09:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:09:52.097509 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:09:52.099007 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:09:52.110854 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36069de-e8a3-4161-bc98-63572c5a1c2d None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:09:52.116343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:09:52.117209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:09:52.117497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:09:52.117776 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] PATH_INFO: `/v3/projects/d47bdc1b685a4817b2be8439a5c5d882` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:09:52.118989 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47bdc1b685a4817b2be8439a5c5d882)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:09:52.121096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:09:52.121096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:09:52.121096 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:09:52.122328 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:09:52.184780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47bdc1b685a4817b2be8439a5c5d882', 'request_id': 'req-3f9df387-95e7-4460-9db3-4812291031df'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:52.194802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47bdc1b685a4817b2be8439a5c5d882', 'request_id': 'req-3f9df387-95e7-4460-9db3-4812291031df'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:52.200793 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47bdc1b685a4817b2be8439a5c5d882', 'request_id': 'req-3f9df387-95e7-4460-9db3-4812291031df'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:52.219934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] The token cache is being invalidate because project d47bdc1b685a4817b2be8439a5c5d882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 10:09:52.220244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:52.220879 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-3f9df387-95e7-4460-9db3-4812291031df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:09:52.222523 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 558/1127] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 12 10:09:52 2022] DELETE /identity/v3/projects/d47bdc1b685a4817b2be8439a5c5d882 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:10:01.743027 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=25 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:10:02.216899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:11:21.687682 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:21.688243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:21.688243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:21.689612 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 570/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:21.694383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf836-920e-422e-9341-59d9887cb266 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:21.694999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf836-920e-422e-9341-59d9887cb266 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:21.694999 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf836-920e-422e-9341-59d9887cb266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:21.760872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-359cf836-920e-422e-9341-59d9887cb266 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:21.762063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-359cf836-920e-422e-9341-59d9887cb266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:21.853587 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 559/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:11:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:22.012434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:22.014105 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:22.102235 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cdd4c-361e-48c4-8e6e-9d5a79f64bb3 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:22.107149 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:22.107823 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:22.108104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:22.108379 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:22.116899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:22.118488 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd28eff-1f8f-4323-a4bb-03201d84ee94 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:22.127849 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 571/1130] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:22.959914 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bcf6-602e-4591-b42f-fdb276c72e4a None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:22.960465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bcf6-602e-4591-b42f-fdb276c72e4a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:22.960465 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76bcf6-602e-4591-b42f-fdb276c72e4a None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:22.961844 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 560/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:22.966831 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf0b8-d218-443c-8881-22c13b58433a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:22.967258 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf0b8-d218-443c-8881-22c13b58433a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:22.967387 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf0b8-d218-443c-8881-22c13b58433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:22.985510 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-288cf0b8-d218-443c-8881-22c13b58433a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:22.986618 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-288cf0b8-d218-443c-8881-22c13b58433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:22.995241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 572/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:11:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:11:23.150678 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76bcf6-602e-4591-b42f-fdb276c72e4a None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:23.164586 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76bcf6-602e-4591-b42f-fdb276c72e4a None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:23.170142 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:23.170847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:23.171130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:23.171406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:23.179628 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:23.181212 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7613b-969c-4a2b-9d93-218b311fe007 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:23.190406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 561/1133] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:27.632834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a3b8-2233-4e59-8de7-941840080cf5 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:27.633551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a3b8-2233-4e59-8de7-941840080cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:27.633551 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a3b8-2233-4e59-8de7-941840080cf5 None None] PATH_INFO: `/v3` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:27.634679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 573/1134] 10.222.0.46 () {54 vars in 925 bytes} [Tue Jul 12 10:11:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 10:11:27.640697 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d3b1-75e8-4a6a-93c2-8bfef3441c39 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:27.641112 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d3b1-75e8-4a6a-93c2-8bfef3441c39 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:27.641267 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d3b1-75e8-4a6a-93c2-8bfef3441c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:27.670289 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-20e5d3b1-75e8-4a6a-93c2-8bfef3441c39 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:27.671502 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-20e5d3b1-75e8-4a6a-93c2-8bfef3441c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:27.725975 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:11:27.735473 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 562/1135] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jul 12 10:11:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:32.980838 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=42 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:11:34.434322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ecae-cbe5-4717-b038-085e9bf20e5b None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:34.434939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ecae-cbe5-4717-b038-085e9bf20e5b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:34.434939 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ecae-cbe5-4717-b038-085e9bf20e5b None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:34.436260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 574/1136] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:34.441520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9355c0-7ad2-4100-9fea-13b03af6f925 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:34.441941 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9355c0-7ad2-4100-9fea-13b03af6f925 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:34.442102 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9355c0-7ad2-4100-9fea-13b03af6f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:34.460966 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6a9355c0-7ad2-4100-9fea-13b03af6f925 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:34.462174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6a9355c0-7ad2-4100-9fea-13b03af6f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:34.469865 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 563/1137] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:11:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:34.628863 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6ecae-cbe5-4717-b038-085e9bf20e5b None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:34.642296 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6ecae-cbe5-4717-b038-085e9bf20e5b None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:34.647182 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:34.647806 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:34.648086 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:34.648356 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:34.656423 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:34.658177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b0a80-eb39-454b-9c2a-2d90072b679f service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:34.667409 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 575/1138] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:35.485050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341582-26cc-4038-9136-c831f5a19e7b None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:35.485598 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341582-26cc-4038-9136-c831f5a19e7b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:35.485598 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341582-26cc-4038-9136-c831f5a19e7b None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:35.487002 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 564/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 10:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:35.492477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c360db-94d6-44c5-b4f3-f96eac6576f4 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:35.492896 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c360db-94d6-44c5-b4f3-f96eac6576f4 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:35.493063 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c360db-94d6-44c5-b4f3-f96eac6576f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:35.510864 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-28c360db-94d6-44c5-b4f3-f96eac6576f4 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:35.512036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-28c360db-94d6-44c5-b4f3-f96eac6576f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:35.519814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 576/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 10:11:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:35.674150 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341582-26cc-4038-9136-c831f5a19e7b None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:35.687800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341582-26cc-4038-9136-c831f5a19e7b None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:35.692657 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:35.693279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:35.693556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:35.693830 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:35.701746 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:35.703359 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137e626-da76-477f-a4e4-e31ca1563aaa service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:35.712500 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 565/1141] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:36.514136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a7f5-396f-408a-8a6e-ee08699897cd None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:36.514635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a7f5-396f-408a-8a6e-ee08699897cd None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:36.514770 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369a7f5-396f-408a-8a6e-ee08699897cd None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:36.516105 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 577/1142] 10.222.0.44 () {54 vars in 960 bytes} [Tue Jul 12 10:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:36.522124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff2b9-7ec3-4484-a7d0-e1126279b4ab None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:36.522558 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff2b9-7ec3-4484-a7d0-e1126279b4ab None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:36.522676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff2b9-7ec3-4484-a7d0-e1126279b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:36.540513 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-daeff2b9-7ec3-4484-a7d0-e1126279b4ab None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:36.541714 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-daeff2b9-7ec3-4484-a7d0-e1126279b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:36.550211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 566/1143] 10.222.0.44 () {58 vars in 1057 bytes} [Tue Jul 12 10:11:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:36.557568 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a7f5-396f-408a-8a6e-ee08699897cd None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:36.571701 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369a7f5-396f-408a-8a6e-ee08699897cd None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:36.577407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:36.578083 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:36.578371 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:36.578679 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:36.587965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:36.589556 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550683d-d71b-4944-b82d-5745299f75b3 service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:36.599098 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 578/1144] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:36 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:39.871343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:39.871923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:39.871923 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:39.873313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 567/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:39.879193 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485587-27ac-4876-9401-f431f342b44b None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:39.879749 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485587-27ac-4876-9401-f431f342b44b None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:39.879749 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485587-27ac-4876-9401-f431f342b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:39.899398 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-07485587-27ac-4876-9401-f431f342b44b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:39.900584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-07485587-27ac-4876-9401-f431f342b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:39.908256 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 579/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:11:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:39.946217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:39.947899 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:40.004148 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960d71-49af-4aae-bc32-347d956ff061 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:40.007638 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:40.008276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:40.008561 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:40.008841 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:40.017582 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:40.019087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7dbbe-4bd6-42c1-8c8f-c43916c3e209 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:40.028255 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 568/1147] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:42.239391 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:42.239953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:42.239953 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:42.241316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 580/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:42.246632 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92bcf-27ff-48e8-9e11-e821864b98f1 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:42.247058 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92bcf-27ff-48e8-9e11-e821864b98f1 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:42.247234 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92bcf-27ff-48e8-9e11-e821864b98f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:42.265401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-95b92bcf-27ff-48e8-9e11-e821864b98f1 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:42.266603 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-95b92bcf-27ff-48e8-9e11-e821864b98f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:42.275244 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 569/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:11:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:42.315870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:42.317581 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:42.330341 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20c5eb-74d0-48c3-aa2e-ceb908f20f83 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:42.334357 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:42.335023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:42.335311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:42.335624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:42.344361 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:42.345788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf0929-4d11-4c97-9678-cd711f064a34 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:42.355166 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 581/1150] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:46.272723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:46.273356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:46.273356 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:46.274661 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 570/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:46.280069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf2f7-fac9-48cc-8660-45b7c4f3be27 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:46.280476 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf2f7-fac9-48cc-8660-45b7c4f3be27 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:46.280629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf2f7-fac9-48cc-8660-45b7c4f3be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:46.298197 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-fbbbf2f7-fac9-48cc-8660-45b7c4f3be27 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:46.299408 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-fbbbf2f7-fac9-48cc-8660-45b7c4f3be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:46.307195 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 582/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:11:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:46.587496 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:46.589129 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:46.645623 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9692b-98e5-438e-8316-16c89a8f5d0f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:46.649092 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d93a53678a488c91c017c500f9c4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:46.649727 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:46.650005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:46.650276 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:46.659559 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:46.660982 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d88c5-512a-473a-9ff9-599ea090d74c service cinder] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:46.670197 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 571/1153] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:48.910104 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:48.910670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:48.910670 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:48.912062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 583/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 10:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:11:48.917045 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e506-b1a9-46a2-afb3-a65112cbf36c None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:48.917446 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e506-b1a9-46a2-afb3-a65112cbf36c None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:48.917637 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e506-b1a9-46a2-afb3-a65112cbf36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:48.935733 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-ae16e506-b1a9-46a2-afb3-a65112cbf36c None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:11:48.936915 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-ae16e506-b1a9-46a2-afb3-a65112cbf36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:48.945259 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 572/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 10:11:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:11:49.218611 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:11:49.220316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:11:49.233613 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383fd0f-2b85-45fa-b829-951aaa546cba None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:11:49.237802 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d93a53678a488c91c017c500f9c4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:11:49.238434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:11:49.238743 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:11:49.239023 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:11:49.248272 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:11:49.249704 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f0de5-bd11-434d-8e7d-376df4e660c0 service cinder] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:11:49.259021 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 584/1156] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:11:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:11:58.930785 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=70 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:11:59.254963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=33 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:07.663081 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d29d4-f859-4b4d-8331-1f53e7d07715 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.663685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d29d4-f859-4b4d-8331-1f53e7d07715 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.663685 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d29d4-f859-4b4d-8331-1f53e7d07715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.669874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5ba1-69a0-418d-9322-aec29ac9115e None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.670386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5ba1-69a0-418d-9322-aec29ac9115e None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.670492 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb5ba1-69a0-418d-9322-aec29ac9115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.682109 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-956d29d4-f859-4b4d-8331-1f53e7d07715 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:07.683345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-956d29d4-f859-4b4d-8331-1f53e7d07715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:07.688886 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-08fb5ba1-69a0-418d-9322-aec29ac9115e None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:07.690066 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-08fb5ba1-69a0-418d-9322-aec29ac9115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:07.691141 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 573/1157] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:07.698048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 585/1158] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:07.699376 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.699671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.699953 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.705608 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.705895 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.706177 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.717796 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:07.719005 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:07.724139 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:07.725294 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:07.727461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 574/1159] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:07.731904 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.733097 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 586/1160] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:07.738069 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.741642 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba44e3-2ed6-44db-8fd5-8283c121860b None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.746476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.747147 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.747273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08372-bedc-482d-9d4b-3bf3304830b5 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.747436 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.747718 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.748467 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:13:07.748780 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.750437 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.751955 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.752584 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.752869 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.753140 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] PATH_INFO: `/v3/domains` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.753855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87401) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 10:13:07.754160 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.755210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:13:07.755210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:13:07.755210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:13:07.756074 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.762106 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 575/1161] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:13:07.774293 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 587/1162] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 10:13:07.774468 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.775282 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.779856 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d31d4d-5d87-4120-93a4-4ae4d7b34d03 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.785083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.785277 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143957-a7c2-463a-b36e-8ed0addad971 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.785725 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.786011 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.786406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.787146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.788283 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:13:07.788283 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:13:07.788283 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:13:07.789499 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.790046 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.790675 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.790991 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.791272 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.791945 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.793849 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.826341 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 576/1163] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:13:07.830733 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 588/1164] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:13:07.831221 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.832624 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.894135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb9f2-76b0-42b4-a925-8150d36b6d78 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.894371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc764-fb91-4746-aa0c-6f282cbe1025 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.898642 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.898811 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.899399 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.899512 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.899685 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.899799 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.899963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.900064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.900663 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.900759 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.901688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:13:07.901688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:13:07.901688 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:13:07.902607 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.902911 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.923165 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 589/1165] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:13:07.928136 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 577/1166] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 12 10:13:07 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 10:13:07.928287 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.929131 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.937330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c9274-19ff-4692-99be-e7c112cf748a admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.938922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3191-4149-49a0-b838-5fc6acbad918 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.942088 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.942751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.943043 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.943323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.943784 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.944049 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.944423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.944711 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.945438 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.945658 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.945762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.947278 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.956223 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 590/1167] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:13:07.960519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 578/1168] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 10:13:07.960671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.961596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.969650 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8150fd-3a44-4b6b-ade8-b49e556cef2a admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.971890 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262186-5238-4e1e-b371-0762194d020e admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:07.975002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.975646 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.975931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.976210 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.976644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:07.976929 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.977282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:07.977568 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:07.977847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:07.978517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.978612 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:07.980179 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:07.988908 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 591/1169] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:13:07.990641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 579/1170] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 10:13:07.992777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:07.994452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:08.004055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b20-29a0-4d56-ae04-25a08056594a admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:08.004710 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207479-30a1-4077-ac66-964dfca8aeb6 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:08.008632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:08.009343 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:08.009495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.009784 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.010064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] PATH_INFO: `/v3/projects/1d922e7efc4a4f47bba8677edb72c7a7/users/d705001efbb74e4fa51b0ffc3c7dcfc5/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.010191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.010472 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.010771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] PATH_INFO: `/v3/projects/ccbb4024fe194358bab0973a600487ba/users/01a78f686aec4ae5bfd37507c2eac4ad/roles/011626f50a8d4ca1b501b232111c2257` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.024874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d922e7efc4a4f47bba8677edb72c7a7, user_id=d705001efbb74e4fa51b0ffc3c7dcfc5, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:08.026273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbb4024fe194358bab0973a600487ba, user_id=01a78f686aec4ae5bfd37507c2eac4ad, role_id=011626f50a8d4ca1b501b232111c2257)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:08.027338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:13:08.027338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:13:08.027338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:13:08.027671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefdd1c-b7b4-49d3-9576-8aa065614971 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:08.029284 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946fa4-cd0a-4223-bce8-f3fa960610ea admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:08.041605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 592/1171] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:07 2022] PUT /identity/v3/projects/1d922e7efc4a4f47bba8677edb72c7a7/users/d705001efbb74e4fa51b0ffc3c7dcfc5/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:13:08.045243 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 580/1172] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:07 2022] PUT /identity/v3/projects/ccbb4024fe194358bab0973a600487ba/users/01a78f686aec4ae5bfd37507c2eac4ad/roles/011626f50a8d4ca1b501b232111c2257 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:13:08.047476 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.047603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.047758 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.047857 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.048028 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.048136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.065017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:08.065191 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] MFA Rules not processed for user `2e6c32588949482cbda554cc2195d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:08.066225 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:08.066373 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:08.108376 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:08.108976 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:08.127994 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 581/1173] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:08.128976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 593/1174] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:08.138353 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:08.138520 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:08.192698 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6c31a-3dc7-4ba5-8ad5-13cfffa4ce5a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:08.193064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff302-62dc-44df-bcbf-8aad1e1d00ac None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:08.196436 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:08.196593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:08.197040 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.197218 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:08.197340 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.197497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:08.197591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.197765 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:08.206945 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:08.207114 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:08.208425 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4aa1a-8065-4e94-8dcf-0a40b9af4680 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:08.208541 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc3f6-bbb5-4632-ab39-94461af2ab04 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:08.217852 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 582/1175] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:08.217996 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 594/1176] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:13:13.336877 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.337774 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.338214 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.367132 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.368248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.369271 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.404855 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:13.406050 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] MFA Rules not processed for user `d705001efbb74e4fa51b0ffc3c7dcfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:13.406386 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:13.408139 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:13.499717 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 595/1177] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:13.504637 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.519559 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f7b42-061b-4658-b6b0-d6952507c393 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.522114 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 583/1178] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:13.528016 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.528454 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.529543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.529543 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.530004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.530987 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.533586 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.545835 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53f11-1482-46ea-ac69-7a8d60956d63 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.551183 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.551985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.552269 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.552641 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.553437 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.555724 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.566521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 596/1179] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:13:13.571042 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.599918 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 584/1180] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:13:13.603750 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.661591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:13.670884 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87d9f-c60d-415b-b884-950e478555b7 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.684604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:13.690813 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416f18-bc4a-4cc7-8802-8c63605fbae1 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.700069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.701394 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.701832 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.702286 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] PATH_INFO: `/v3/users` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.703181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.706991 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.740383 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 585/1181] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:13:13.744608 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.755002 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.755702 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.755985 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.756265 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.756974 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.758970 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.760757 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e4e21-5e66-4f9c-8520-a82f51c01de1 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.765423 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.766279 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.766557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.767918 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.769033 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.771124 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.782344 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 586/1182] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:13:13.782781 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 597/1183] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 12 10:13:13 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 10:13:13.786659 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.789406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.796810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77284a-1bdb-4944-8356-5aec46a5dfb6 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.802203 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.802461 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735821-f6dc-4298-b502-b39c48a5ebb3 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.803058 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.803433 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.803757 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.804560 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.806240 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.808713 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.809859 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.810299 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.810775 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] PATH_INFO: `/v3/projects/6a1a3582234948fd900914d15fc25a9d/users/4106857c229041b987692331ae9263d9/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.817499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 598/1184] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 10:13:13.821677 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.832899 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e271-70fe-4919-96b3-6de069ce6a48 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:13.833622 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1a3582234948fd900914d15fc25a9d, user_id=4106857c229041b987692331ae9263d9, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.836684 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.840903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:13.842048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:13.843134 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:13.843502 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] PATH_INFO: `/v3/projects/e6aac42143d24b6a9f43e6178422e390/users/260971a80fce44638164ef905852ce03/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:13.857891 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 587/1185] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:13 2022] PUT /identity/v3/projects/6a1a3582234948fd900914d15fc25a9d/users/4106857c229041b987692331ae9263d9/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:13:13.862341 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.873691 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aac42143d24b6a9f43e6178422e390, user_id=260971a80fce44638164ef905852ce03, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:13.877394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:13.899566 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 599/1186] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:13 2022] PUT /identity/v3/projects/e6aac42143d24b6a9f43e6178422e390/users/260971a80fce44638164ef905852ce03/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:13:13.900461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:13.964742 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a865f-d14a-416b-8819-0e57ce86d522 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:14.005130 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5133a-41d9-4604-9e89-b3da68fb56af admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:14.011396 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:14.011976 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:14.012586 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:14.012870 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] PATH_INFO: `/v3/roles` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:14.013613 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:14.015385 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:14.029251 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:14.029949 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:14.030263 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:14.030519 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:14.031273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:14.033470 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:14.037508 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 600/1187] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 10:13:14.042890 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:14.053271 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 588/1188] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 12 10:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 10:13:14.053975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70793435-acbc-4192-8b9a-3d41fd03e775 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:14.054266 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:14.059998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:14.061270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:14.061734 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:14.062788 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] PATH_INFO: `/v3/projects/e6aac42143d24b6a9f43e6178422e390/users/260971a80fce44638164ef905852ce03/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:14.065481 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aac42143d24b6a9f43e6178422e390, user_id=260971a80fce44638164ef905852ce03, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:14.066106 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7947b-00de-4564-9b2d-21df983a16dd admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:14.068947 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97fd5c5-fa93-40a9-ae6f-d58d69a513d5 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:14.075548 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:14.076464 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] REQUEST_METHOD: `PUT` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:14.076756 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:14.077038 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] PATH_INFO: `/v3/projects/6a1a3582234948fd900914d15fc25a9d/users/4106857c229041b987692331ae9263d9/roles/9ebf48ed1d4a47beaf172db42a118091` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:14.081644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1a3582234948fd900914d15fc25a9d, user_id=4106857c229041b987692331ae9263d9, role_id=9ebf48ed1d4a47beaf172db42a118091)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:14.085338 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:14.088804 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 601/1189] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:14 2022] PUT /identity/v3/projects/e6aac42143d24b6a9f43e6178422e390/users/260971a80fce44638164ef905852ce03/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:13:14.107842 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 589/1190] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 12 10:13:14 2022] PUT /identity/v3/projects/6a1a3582234948fd900914d15fc25a9d/users/4106857c229041b987692331ae9263d9/roles/9ebf48ed1d4a47beaf172db42a118091 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:13:20.300185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e50c9-415a-4e89-97d5-ea1f6a6af87c None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:20.300773 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e50c9-415a-4e89-97d5-ea1f6a6af87c None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:20.301009 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e50c9-415a-4e89-97d5-ea1f6a6af87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:20.367605 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-fc5e50c9-415a-4e89-97d5-ea1f6a6af87c None None] MFA Rules not processed for user `4106857c229041b987692331ae9263d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:20.369274 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-fc5e50c9-415a-4e89-97d5-ea1f6a6af87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:20.447487 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:20.510687 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 602/1191] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:20 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:20.525250 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:20.527074 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:20.650926 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:20.687611 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33737-dd07-4cfa-b846-27ed303da289 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:20.691604 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6ce16a904a6f9ebf67c6cd3e935b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:20.698824 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:20.699166 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:20.699401 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:20.806690 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98815e2-3b65-4b2f-be55-ce615662e995 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:20.807601 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98815e2-3b65-4b2f-be55-ce615662e995 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:20.807965 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98815e2-3b65-4b2f-be55-ce615662e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:20.830167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:20.832937 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:20.852753 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 590/1192] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:20 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:20.857635 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a98815e2-3b65-4b2f-be55-ce615662e995 None None] MFA Rules not processed for user `260971a80fce44638164ef905852ce03`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:20.859020 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a98815e2-3b65-4b2f-be55-ce615662e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:20.966146 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 603/1193] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:20 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:20.981174 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:20.993211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9ea69-b228-40b0-9233-bdfe13acc4a6 service glance] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:21.005370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6ce16a904a6f9ebf67c6cd3e935b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:21.006034 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:21.006318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:21.006596 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:21.097481 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:21.099310 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24739-f0cc-4f6f-b670-fbf8114f7c64 service glance] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:21.118474 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 591/1194] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:20 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:29.521728 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60d26-ad4c-4aa8-a6ad-3cb03cf0f617 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:29.522323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60d26-ad4c-4aa8-a6ad-3cb03cf0f617 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:29.522323 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60d26-ad4c-4aa8-a6ad-3cb03cf0f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:29.544307 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-dfb60d26-ad4c-4aa8-a6ad-3cb03cf0f617 None None] MFA Rules not processed for user `d705001efbb74e4fa51b0ffc3c7dcfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:29.545534 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-dfb60d26-ad4c-4aa8-a6ad-3cb03cf0f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:29.552924 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 604/1195] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:13:29 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:29.843453 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909d06-fbee-4976-95af-46509da7f1d9 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:29.844059 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909d06-fbee-4976-95af-46509da7f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:29.844452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909d06-fbee-4976-95af-46509da7f1d9 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:29.846516 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 592/1196] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 12 10:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:29.856117 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03dc1-ca23-4046-8c6c-76cff2980b1f None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:29.856451 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03dc1-ca23-4046-8c6c-76cff2980b1f None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:29.856744 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03dc1-ca23-4046-8c6c-76cff2980b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:29.896329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-30e03dc1-ca23-4046-8c6c-76cff2980b1f None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:29.897638 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-30e03dc1-ca23-4046-8c6c-76cff2980b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:29.962036 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 605/1197] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 12 10:13:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:29.967480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:29.967789 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:29.968072 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:29.969510 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 593/1198] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 12 10:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:29.975394 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da69d7-47e3-4f55-8ffe-72ed0308f34a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:29.975868 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da69d7-47e3-4f55-8ffe-72ed0308f34a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:29.976342 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da69d7-47e3-4f55-8ffe-72ed0308f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:29.996477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-41da69d7-47e3-4f55-8ffe-72ed0308f34a None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:29.997685 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-41da69d7-47e3-4f55-8ffe-72ed0308f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:30.006322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 606/1199] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 12 10:13:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:30.018146 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:30.019942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:30.033440 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d0cbc-8eaf-4461-8db5-2e8ddf1ca267 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:30.036959 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6ce16a904a6f9ebf67c6cd3e935b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:30.037593 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:30.037872 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:30.038143 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:30.047749 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:30.049815 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056abcb-15d2-4baa-a4cc-d21d91795cbc service glance] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:30.059895 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 594/1200] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:30.400749 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1821d-5dac-4eb6-91cc-98180fae6f59 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:30.401045 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1821d-5dac-4eb6-91cc-98180fae6f59 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:30.401367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1821d-5dac-4eb6-91cc-98180fae6f59 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:30.402724 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 607/1201] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 12 10:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:30.408751 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ce70-ed36-481f-9190-67b37b76e50d None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:30.409042 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ce70-ed36-481f-9190-67b37b76e50d None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:30.409319 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203ce70-ed36-481f-9190-67b37b76e50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:30.445242 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-7203ce70-ed36-481f-9190-67b37b76e50d None None] MFA Rules not processed for user `f2a50a8a6aeb466fa87b4b8773658f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:30.446653 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-7203ce70-ed36-481f-9190-67b37b76e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:30.507130 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 595/1202] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 12 10:13:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:30.520496 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1821d-5dac-4eb6-91cc-98180fae6f59 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:30.531552 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1821d-5dac-4eb6-91cc-98180fae6f59 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:30.540882 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:30.541684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:30.541860 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:30.542545 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:30.555903 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:30.557799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e0bde-0cef-4f14-9424-3a256cfd54d7 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:30.570641 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 608/1203] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:30 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:31.013089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce59b-111f-4dc9-a3b4-d30bd3e641a4 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.013089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce59b-111f-4dc9-a3b4-d30bd3e641a4 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.013089 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce59b-111f-4dc9-a3b4-d30bd3e641a4 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.014738 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 596/1204] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 12 10:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:31.021879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11299cd-a255-4c5d-8437-8799b924baee None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.022292 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11299cd-a255-4c5d-8437-8799b924baee None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.022720 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11299cd-a255-4c5d-8437-8799b924baee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.031021 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357118f-9f35-42af-a408-31808c609c46 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.031396 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357118f-9f35-42af-a408-31808c609c46 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.031744 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357118f-9f35-42af-a408-31808c609c46 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.036702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 597/1205] 10.222.0.44 () {54 vars in 960 bytes} [Tue Jul 12 10:13:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:13:31.041676 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d3f-ce7d-4acc-b861-36ee6d944546 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.042040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d3f-ce7d-4acc-b861-36ee6d944546 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.042390 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d3f-ce7d-4acc-b861-36ee6d944546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.044998 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a11299cd-a255-4c5d-8437-8799b924baee None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:31.046270 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a11299cd-a255-4c5d-8437-8799b924baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:31.061800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 609/1206] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 12 10:13:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:31.068712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0ded0-a80c-43ca-9d69-e82f5249f6e0 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.068712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0ded0-a80c-43ca-9d69-e82f5249f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.068712 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0ded0-a80c-43ca-9d69-e82f5249f6e0 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.070062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 610/1207] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 12 10:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 10:13:31.072805 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-bb9b6d3f-ce7d-4acc-b861-36ee6d944546 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:31.075247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.075816 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-bb9b6d3f-ce7d-4acc-b861-36ee6d944546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:31.076061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.076649 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.081723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=100 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:31.088137 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=100 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:31.104414 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:31.106620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:31.118113 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 611/1208] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 12 10:13:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:31.129997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:31.143479 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20b76-5bbf-4918-819a-561986e891ca None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:31.147354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:31.148016 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.148297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.148593 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.163834 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:31.165756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:31.178935 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 612/1209] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:31.211329 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:31.224200 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 598/1210] 10.222.0.44 () {58 vars in 1057 bytes} [Tue Jul 12 10:13:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 10:13:31.229467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e78e2a-9501-4f2d-90f4-7e5189dd8d30 service neutron] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:31.240176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:31.241109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:31.241246 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:31.241592 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:31.243777 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:31.256447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:31.258103 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:31.277681 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 613/1211] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:31 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:41.171930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=25 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:41.268856 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=13 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:42.727213 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c257a2-4247-40a8-9ee8-0a4efeea4b1f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:42.727746 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c257a2-4247-40a8-9ee8-0a4efeea4b1f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:42.727837 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c257a2-4247-40a8-9ee8-0a4efeea4b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:42.753318 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-b4c257a2-4247-40a8-9ee8-0a4efeea4b1f None None] MFA Rules not processed for user `f2a50a8a6aeb466fa87b4b8773658f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:42.754664 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-b4c257a2-4247-40a8-9ee8-0a4efeea4b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:42.761896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 599/1212] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jul 12 10:13:42 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:42.773742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:42.783531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9c9d-9795-4dfb-b66e-9774d30dcd3f service placement] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:42.787053 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:42.787686 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:42.787972 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:42.788422 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:42.795527 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:42.796994 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c8ae4-3879-431a-8bd4-20012c174c0d service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:42.806055 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 614/1213] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:42 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:43.676802 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba71c-ea48-4d7e-83c0-96d546a6a363 None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:43.677396 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba71c-ea48-4d7e-83c0-96d546a6a363 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:43.677773 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ba71c-ea48-4d7e-83c0-96d546a6a363 None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:43.680113 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 600/1214] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:43.692569 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bee-44fe-4e1c-8774-8fd8276e2917 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:43.693082 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bee-44fe-4e1c-8774-8fd8276e2917 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:43.693434 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bee-44fe-4e1c-8774-8fd8276e2917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:43.725847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-a9d40bee-44fe-4e1c-8774-8fd8276e2917 None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:43.727960 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a9d40bee-44fe-4e1c-8774-8fd8276e2917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:43.740598 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 615/1215] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:13:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:43.777638 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba71c-ea48-4d7e-83c0-96d546a6a363 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:43.801905 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ba71c-ea48-4d7e-83c0-96d546a6a363 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:43.808933 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:43.809609 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:43.809915 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:43.810167 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:43.820689 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:43.822298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5b68e-cfe4-4123-a2e0-f0755a19127c service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:43.846463 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 601/1216] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:43 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:49.615880 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075907e6-7eac-4ed4-ba46-ddfdb9f1a069 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:49.616499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075907e6-7eac-4ed4-ba46-ddfdb9f1a069 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:49.616499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075907e6-7eac-4ed4-ba46-ddfdb9f1a069 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:49.618480 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 616/1217] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:13:49.626403 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:49.626980 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:49.627181 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:49.647001 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:13:49.648298 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:13:49.657296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 602/1218] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:13:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:13:49.671176 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075907e6-7eac-4ed4-ba46-ddfdb9f1a069 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:13:49.686093 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075907e6-7eac-4ed4-ba46-ddfdb9f1a069 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:13:49.691877 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:13:49.692517 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:13:49.692800 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:13:49.693073 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:13:49.702154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:13:49.704327 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bb92b-cae8-4867-86bf-f103cc95c22c service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:13:49.714188 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 617/1219] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:13:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:13:59.641771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=12 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:13:59.709999 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=15 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:01.486969 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:14:01.496605 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b72f-ff43-426e-89dd-cdb1e5035565 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:14:01.502243 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:14:01.502930 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:01.503416 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:01.503704 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:01.514329 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:14:01.516554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297df2b5-8003-4f59-a1d0-2a9ff97c07fd service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:14:01.527966 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 603/1220] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:14:01 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:14:03.501207 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0986-3b6c-443f-a4dd-ddb1ecf9c791 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:03.501809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0986-3b6c-443f-a4dd-ddb1ecf9c791 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:03.501809 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0986-3b6c-443f-a4dd-ddb1ecf9c791 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:03.503521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 618/1221] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:14:03.508990 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2643ac-ccbe-44d2-a49e-69ecf3856cf7 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:03.509484 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2643ac-ccbe-44d2-a49e-69ecf3856cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:03.509669 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2643ac-ccbe-44d2-a49e-69ecf3856cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:03.544735 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-eb2643ac-ccbe-44d2-a49e-69ecf3856cf7 None None] MFA Rules not processed for user `b2080c582ab448d587b35d6a100cad12`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:14:03.547371 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-eb2643ac-ccbe-44d2-a49e-69ecf3856cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:14:03.562636 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 604/1222] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:14:03 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:14:03.577931 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0986-3b6c-443f-a4dd-ddb1ecf9c791 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:14:03.600218 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0986-3b6c-443f-a4dd-ddb1ecf9c791 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:14:03.611626 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:14:03.612495 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:03.612879 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:03.613258 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:03.627782 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:14:03.630243 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4c3c6-be10-4d2d-be35-ffa0adc13d4c service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:14:03.646751 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 619/1223] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:14:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:14:13.535700 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=9 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:13.641089 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=6 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:18.681699 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c439-1bc4-49b2-9424-abf338a6034e None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:18.682201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c439-1bc4-49b2-9424-abf338a6034e None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:18.682296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c439-1bc4-49b2-9424-abf338a6034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:18.699877 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-6fc4c439-1bc4-49b2-9424-abf338a6034e None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:14:18.701069 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-6fc4c439-1bc4-49b2-9424-abf338a6034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:14:18.708518 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 605/1224] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:14:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:14:28.694884 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:43.521975 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:43.522458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:43.522576 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:43.540185 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:14:43.541367 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:14:43.548135 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 620/1225] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:14:43 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:14:43.843231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6bc07-d90d-43d6-9005-4d4a10dee208 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:43.843690 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6bc07-d90d-43d6-9005-4d4a10dee208 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:43.843798 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6bc07-d90d-43d6-9005-4d4a10dee208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:43.861097 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-94c6bc07-d90d-43d6-9005-4d4a10dee208 None None] MFA Rules not processed for user `f2a50a8a6aeb466fa87b4b8773658f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:14:43.862281 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-94c6bc07-d90d-43d6-9005-4d4a10dee208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:14:43.868970 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 606/1226] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 12 10:14:43 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:14:43.880194 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:14:43.889410 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd32bf-f485-456c-aa01-efc6644de3cf None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:14:43.893499 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:14:43.894123 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:43.894402 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:43.894680 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:43.901753 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:14:43.903245 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a65953-40cf-4855-8d79-f1fff6c31f82 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:14:43.910791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 621/1227] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:14:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 10:14:53.856243 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:53.907538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=9 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:14:58.240168 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:14:58.240616 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:14:58.240722 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:14:58.257787 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:14:58.258983 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:14:58.265680 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 607/1228] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:14:58 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:15:08.252858 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:15:57.683993 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:15:57.684467 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:15:57.684553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:15:57.701413 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:15:57.703136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:15:57.709790 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 622/1229] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:15:57 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:16:07.696461 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=3 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:16:10.547410 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:16:10.565586 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ba723-6cf6-4bf4-86be-172e4936553a None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:16:10.569080 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:16:10.569740 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:16:10.570019 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:16:10.570293 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:16:10.579762 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:16:10.581203 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42daecaa-6757-433c-ae31-2825dca184f4 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:16:10.590535 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 608/1230] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:16:10 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:16:20.586406 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=10 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:17:34.636372 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:17:34.659273 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd86f8a-4427-4979-9c5a-29cc9b51d292 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:17:34.665663 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:17:34.666599 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:17:34.667064 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:17:34.667447 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:17:34.677847 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:17:34.679672 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:17:34.691469 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 623/1231] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:17:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:17:44.686311 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=10 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:17:54.284208 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:17:54.284702 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:17:54.284875 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:17:54.303083 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] MFA Rules not processed for user `d705001efbb74e4fa51b0ffc3c7dcfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:17:54.304295 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:17:54.311087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 609/1232] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:17:54 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:18:04.297847 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=3 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:18:20.139531 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:18:20.149087 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f2336-6cd4-40b1-884f-7477e9df5241 service placement] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:18:20.152736 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:18:20.153366 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:20.153647 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:20.153923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:20.163651 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:18:20.165138 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d67554-679e-4599-892f-2a26349b24e6 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:18:20.173982 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 624/1233] 10.222.0.44 () {60 vars in 1396 bytes} [Tue Jul 12 10:18:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2810 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:18:21.168497 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:18:21.178997 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c495e2-e221-4814-8092-9fcd70ef032f None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:18:21.183219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:18:21.183927 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:21.184313 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:21.184806 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:21.197723 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:18:21.199339 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:18:21.210201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 610/1234] 10.222.0.44 () {60 vars in 1396 bytes} [Tue Jul 12 10:18:21 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2804 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:18:22.495629 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:22.496136 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:22.496397 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:22.515202 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:18:22.516567 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:18:22.525620 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 625/1235] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:18:22 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:18:31.205178 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=6 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:18:32.076143 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:18:32.085040 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0de4-88aa-4f3b-a7c6-a30b2fb3ef69 service neutron] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:18:32.088627 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:18:32.089247 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:32.089525 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:32.089800 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:32.099556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:18:32.101003 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:18:32.120108 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 611/1236] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:18:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:18:32.509984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=9 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:18:34.460075 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:18:34.469430 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b59110-3895-44d7-85c7-87b1db3a40b2 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:18:34.473553 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:18:34.474183 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:34.474463 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:34.474762 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:34.483805 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:18:34.485229 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:18:34.495292 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 626/1237] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:18:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:18:42.117489 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=10 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:18:44.491068 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=6 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:18:49.845219 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:18:49.853935 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d0b3b-3095-40b6-a0f9-e91e2eef4e5c service neutron] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:18:49.857655 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:18:49.858328 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:18:49.858612 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:18:49.858929 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:18:49.867273 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:18:49.868696 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:18:49.876486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 612/1238] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:18:49 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:18:59.873186 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=6 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:19:37.302811 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:37.321997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7270f2-7ea7-41c8-a140-200382375a81 service neutron] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:37.340776 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:37.342050 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:37.342458 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:37.342865 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:37.355921 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:37.363632 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:37.376600 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 627/1239] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:19:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:19:38.514296 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:38.537554 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4052-e822-497d-a959-de3fb6ff8788 service neutron] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:38.543758 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:38.544792 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:38.545386 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:38.546087 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:38.558416 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:38.560660 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27487f-adac-4af1-af16-a01f86455968 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:38.577524 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 613/1240] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:19:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:19:45.057507 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:45.067109 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bc8f8-5e7d-45d2-bf48-d46483a606f6 service nova] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:45.070832 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:45.071477 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:45.071763 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:45.072041 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:45.133511 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:45.135006 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680522-7330-4ce9-bcb3-d31223e1cd88 service neutron] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:45.153799 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 628/1241] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:19:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:19:48.345586 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929bbd-d4db-473f-a8eb-bfc558d8eb2d None None] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:48.346113 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929bbd-d4db-473f-a8eb-bfc558d8eb2d None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:48.346323 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929bbd-d4db-473f-a8eb-bfc558d8eb2d None None] PATH_INFO: `/` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:48.347987 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 614/1242] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:19:48.360826 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:48.361548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:48.361548 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:48.432684 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:19:48.433947 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:19:48.442810 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 629/1243] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:19:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:19:48.570345 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=6 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:19:48.669671 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83929bbd-d4db-473f-a8eb-bfc558d8eb2d None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:48.685571 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83929bbd-d4db-473f-a8eb-bfc558d8eb2d None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:48.691534 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:48.692577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:48.692942 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:48.693294 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:48.703035 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:48.704713 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:48.714576 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 615/1244] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:19:48 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:19:51.561260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:51.573490 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fdd1-44e2-44be-b366-21558c7ed13a None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:51.581737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:51.582651 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:51.582971 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:51.583263 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] PATH_INFO: `/v3/users/d705001efbb74e4fa51b0ffc3c7dcfc5` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:51.584468 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d705001efbb74e4fa51b0ffc3c7dcfc5)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:51.586407 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:51.634354 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd705001efbb74e4fa51b0ffc3c7dcfc5'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.635154 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd705001efbb74e4fa51b0ffc3c7dcfc5'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.647062 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd705001efbb74e4fa51b0ffc3c7dcfc5'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.653756 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd705001efbb74e4fa51b0ffc3c7dcfc5'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.661203 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd705001efbb74e4fa51b0ffc3c7dcfc5'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.667591 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 630/1245] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 12 10:19:51 2022] DELETE /identity/v3/users/d705001efbb74e4fa51b0ffc3c7dcfc5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:19:51.857774 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:51.870064 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093958-3363-45b3-8e9c-a3b9acbeb47f service placement] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:51.926195 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:51.927085 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:51.927369 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:51.927644 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] PATH_INFO: `/v3/projects/1d922e7efc4a4f47bba8677edb72c7a7` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:51.928809 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d922e7efc4a4f47bba8677edb72c7a7)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:51.930737 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:51.976264 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d922e7efc4a4f47bba8677edb72c7a7', 'request_id': 'req-a28d6a19-43a1-4065-801e-bdfa503a96fb'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.983362 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d922e7efc4a4f47bba8677edb72c7a7', 'request_id': 'req-a28d6a19-43a1-4065-801e-bdfa503a96fb'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:51.989555 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d922e7efc4a4f47bba8677edb72c7a7', 'request_id': 'req-a28d6a19-43a1-4065-801e-bdfa503a96fb'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.000557 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] The token cache is being invalidate because project 1d922e7efc4a4f47bba8677edb72c7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 10:19:52.000843 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.001486 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.003060 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 616/1246] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 12 10:19:51 2022] DELETE /identity/v3/projects/1d922e7efc4a4f47bba8677edb72c7a7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:19:52.007095 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:52.008485 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:19:52.018513 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:19:52.022798 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8885a-361e-4b8b-9d57-860d7419ed0e admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:52.079872 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:52.080742 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:52.081019 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:52.081297 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] PATH_INFO: `/v3/users/4106857c229041b987692331ae9263d9` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:52.082473 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4106857c229041b987692331ae9263d9)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:52.084448 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:52.129871 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4106857c229041b987692331ae9263d9'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.130563 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4106857c229041b987692331ae9263d9'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.142997 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4106857c229041b987692331ae9263d9'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.149923 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4106857c229041b987692331ae9263d9'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.157464 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-2ab20326-eaa1-4512-8a26-cb433d6506a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4106857c229041b987692331ae9263d9'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.163737 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 631/1247] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 12 10:19:52 2022] DELETE /identity/v3/users/4106857c229041b987692331ae9263d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:19:52.335412 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:19:52.336827 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:19:52.351577 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d6a19-43a1-4065-801e-bdfa503a96fb admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:19:52.411326 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:19:52.412192 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:19:52.412480 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:19:52.412760 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] PATH_INFO: `/v3/projects/6a1a3582234948fd900914d15fc25a9d` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:19:52.413934 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1a3582234948fd900914d15fc25a9d)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:19:52.415892 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:19:52.437160 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:19:52.463873 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1a3582234948fd900914d15fc25a9d', 'request_id': 'req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.471709 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1a3582234948fd900914d15fc25a9d', 'request_id': 'req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.477370 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1a3582234948fd900914d15fc25a9d', 'request_id': 'req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.489165 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] The token cache is being invalidate because project 6a1a3582234948fd900914d15fc25a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 10:19:52.489457 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.490093 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:19:52.491658 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 617/1248] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 12 10:19:52 2022] DELETE /identity/v3/projects/6a1a3582234948fd900914d15fc25a9d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 10:20:02.159964 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:20:02.485896 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:20:20.460801 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] REQUEST_METHOD: `POST` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:20:20.461306 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:20:20.461403 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:20:20.479054 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.auth.core [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] MFA Rules not processed for user `01a78f686aec4ae5bfd37507c2eac4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=87401) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:20:20.480241 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:20.533537 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 632/1249] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 12 10:20:20 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:20:20.843782 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:20:20.845264 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:20.901520 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693939-4d0f-43b5-adff-f7ff25a9fcd6 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:20:20.905637 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:20:20.906224 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:20:20.906513 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:20:20.906838 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:20:20.908556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:20.917771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:20:20.919248 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:20:20.927646 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 618/1250] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:20:20 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:20:21.360874 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:20:21.362602 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:21.436199 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e27e-35ff-4a2f-8098-b5b41a8ca112 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:20:21.441122 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:20:21.441765 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:20:21.442048 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:20:21.442330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:20:21.444250 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:21.456963 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:20:21.458570 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:20:21.468984 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 633/1251] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:20:21 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:20:29.590603 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:20:29.593084 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:29.673936 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499732e9-e980-4288-892e-5446c9c9981d service neutron] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:20:29.678902 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2080c582ab448d587b35d6a100cad12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:20:29.679552 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:20:29.679839 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:20:29.680121 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:20:29.681880 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:20:29.692947 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:20:29.694530 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:20:29.704282 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 619/1252] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:20:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:20:31.464316 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=57 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:20:39.700201 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=58 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:22:39.894595 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:22:39.896017 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:22:39.958425 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb96b-ab3b-48cc-9ff9-bd0305d3859c service placement] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:22:39.964330 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:22:39.964988 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:22:39.965322 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:22:39.965607 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:22:39.967562 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:22:39.980202 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:22:39.981797 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e105bc-3390-48a4-be56-650e06df3818 service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:22:39.992304 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 634/1253] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:22:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:22:49.988189 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=28 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:23:05.521963 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:05.543231 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8628-b57d-42ef-bf30-cc43c4bc78c5 service nova] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:05.546810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2a50a8a6aeb466fa87b4b8773658f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:05.547452 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] REQUEST_METHOD: `GET` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:05.547739 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:05.548017 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:05.549771 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:23:05.632292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:05.633732 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c55c3-663d-4ab6-a06f-797cb1a209db service neutron] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:05.644350 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 620/1254] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:23:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:23:08.800538 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84230-16e2-4463-a5a3-850d8384d2a9 None None] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:08.801061 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84230-16e2-4463-a5a3-850d8384d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:08.801248 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd84230-16e2-4463-a5a3-850d8384d2a9 None None] PATH_INFO: `/` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:08.804814 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 635/1255] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 12 10:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 10:23:08.814211 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] REQUEST_METHOD: `POST` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:08.814659 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:08.814810 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:08.843531 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.auth.core [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] MFA Rules not processed for user `0fecde7214c54a369c5235a8122d47a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 10:23:08.844880 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:23:08.854325 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 621/1256] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 12 10:23:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 10:23:08.865671 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84230-16e2-4463-a5a3-850d8384d2a9 None None] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:08.879435 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd84230-16e2-4463-a5a3-850d8384d2a9 None None] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:08.886959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fecde7214c54a369c5235a8122d47a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b427b99ec90245c2ac53ed43ce632360', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:08.886959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] REQUEST_METHOD: `GET` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:08.886959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:08.886959 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:08.896004 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:08.897603 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:08.908334 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 636/1257] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 12 10:23:08 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 10:23:11.978063 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:11.980118 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:23:11.994315 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23fd91-8b81-446e-be77-a2e34083c4b8 None None] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:11.999029 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:12.000292 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:12.000705 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:12.001119 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] PATH_INFO: `/v3/users/01a78f686aec4ae5bfd37507c2eac4ad` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:12.019703 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a78f686aec4ae5bfd37507c2eac4ad)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:12.020826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: WARNING py.warnings [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:23:12.020826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: warnings.warn(msg) Jul 12 10:23:12.020826 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: Jul 12 10:23:12.022075 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:12.086782 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a78f686aec4ae5bfd37507c2eac4ad'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.104209 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a78f686aec4ae5bfd37507c2eac4ad'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.114556 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a78f686aec4ae5bfd37507c2eac4ad'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.122482 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a78f686aec4ae5bfd37507c2eac4ad'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.123199 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a78f686aec4ae5bfd37507c2eac4ad'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.129120 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 622/1258] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 12 10:23:11 2022] DELETE /identity/v3/users/01a78f686aec4ae5bfd37507c2eac4ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:23:12.299450 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:12.311763 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1abbba-2ee3-44d9-bb89-6cd363ba50cf service placement] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:12.369465 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:12.370325 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:12.370610 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:12.370934 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] PATH_INFO: `/v3/projects/ccbb4024fe194358bab0973a600487ba` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:12.381143 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbb4024fe194358bab0973a600487ba)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:12.382260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: WARNING py.warnings [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 10:23:12.382260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: warnings.warn(msg) Jul 12 10:23:12.382260 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: Jul 12 10:23:12.384085 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:12.441295 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbb4024fe194358bab0973a600487ba', 'request_id': 'req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.448424 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbb4024fe194358bab0973a600487ba', 'request_id': 'req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.454791 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbb4024fe194358bab0973a600487ba', 'request_id': 'req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.472459 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] The token cache is being invalidate because project ccbb4024fe194358bab0973a600487ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 10:23:12.472750 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.473393 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.474977 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 637/1259] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 12 10:23:12 2022] DELETE /identity/v3/projects/ccbb4024fe194358bab0973a600487ba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:23:12.479436 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Authenticating user token {{(pid=87402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:12.480851 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.fernet_utils [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:23:12.494670 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406ad9-f938-43c6-8073-d054a45995b9 admin admin] Validating token access rules against request {{(pid=87402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:12.499366 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:23:12.552052 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:12.552985 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:12.553272 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:12.553553 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] PATH_INFO: `/v3/users/260971a80fce44638164ef905852ce03` {{(pid=87402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:12.554922 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260971a80fce44638164ef905852ce03)` {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:12.557411 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] RBAC: Authorization granted {{(pid=87402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:12.602729 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260971a80fce44638164ef905852ce03'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.614938 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260971a80fce44638164ef905852ce03'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.622217 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260971a80fce44638164ef905852ce03'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.629188 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260971a80fce44638164ef905852ce03'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.629811 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG keystone.notifications [None req-b5e04a43-2ef4-4aa0-aa51-1cd68fea01c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260971a80fce44638164ef905852ce03'} {{(pid=87402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.635688 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: [pid: 87402|app: 0|req: 623/1260] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 12 10:23:12 2022] DELETE /identity/v3/users/260971a80fce44638164ef905852ce03 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:23:12.810625 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Authenticating user token {{(pid=87401) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 10:23:12.812168 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.fernet_utils [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87401) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 10:23:12.825247 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd3149-2b2a-4d74-8f1a-2be3e3b64f46 admin admin] Validating token access rules against request {{(pid=87401) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 10:23:12.883850 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e6c32588949482cbda554cc2195d9cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee04a4e0146d43939fce14ce28c51a00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87401) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 10:23:12.884713 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 10:23:12.885001 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 10:23:12.885284 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] PATH_INFO: `/v3/projects/e6aac42143d24b6a9f43e6178422e390` {{(pid=87401) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 10:23:12.886493 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6aac42143d24b6a9f43e6178422e390)` {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 10:23:12.888470 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] RBAC: Authorization granted {{(pid=87401) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 10:23:12.899839 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:23:12.936628 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6aac42143d24b6a9f43e6178422e390', 'request_id': 'req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.943695 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6aac42143d24b6a9f43e6178422e390', 'request_id': 'req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.949521 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6aac42143d24b6a9f43e6178422e390', 'request_id': 'req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73'} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.960920 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] The token cache is being invalidate because project e6aac42143d24b6a9f43e6178422e390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87401) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 10:23:12.961232 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.961836 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG keystone.notifications [None req-408057b9-fdf6-48ec-9ff5-fb4ea9e68f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87401) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 10:23:12.963412 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: [pid: 87401|app: 0|req: 638/1261] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 12 10:23:12 2022] DELETE /identity/v3/projects/e6aac42143d24b6a9f43e6178422e390 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 10:23:22.632153 dv-osbrick-849324-2-ceph devstack@keystone.service[87402]: DEBUG dbcounter [-] [87402] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 10:23:22.957478 dv-osbrick-849324-2-ceph devstack@keystone.service[87401]: DEBUG dbcounter [-] [87401] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}